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(57) The characteristic amounts of videos about the 
far and near images are extracted from a plurality of par- 
allax calculating areas set in one field picture at every 
field based on twoKiimensional input video signals. 
Then, parallax information is generated at every prede- 
termined unit area in one field picture based on the 
characteristic amount of videos extracted at every paral- 
lax area. Thereafter, first and second video signals hav- 
ing a horizontal phase difference are generated from 
the signals in each predetermined unit area of the two- 
dimensional input video signals in accordance with the 
parallax information corresponding to the predeter- 
mined unit areas. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 5 

[0OO1] The present invention relates generally to an 
apparatus and method for converting two-dimensional 
images into three-dimensional Images. 

10 

Related Art 
[0OO2] 

[1] There has been known a method for converting is 
2D images into 3D images, which method utilizes 
field memories for generating an image signal 
(hereinafter referred to as "^dela/ed image signal'^ 
time-delayed relative to an original 2D Image signal 
so as to output either one of the original 2D image 20 
signal and the delayed image signal as a left-eye 
image signal and the other as a right-eye image sig- 
nal. Unfortunately, however, this method has a dis- 
advantage of high costs because the field 
memories are necessary for generating the image 2S 
signal time-delayed relative to the original 2D image 
signal. In addition, this method is adapted to con- 
vert only 2D motion images into 3D motion images. 

It is, therefore, an object of the Invention to pro- 
vide an apparatus and method for converting the 30 
2D images into the 3D images, which apparatus 
and method negate the need for the field memories 
for generating the image signal time-delayed rela- 
tive to the original 2D image signal, thereby accom- 
plishing the cost reduction. 35 

It is another object of the Invention to provide 
an apparatus and method for converting the 2D 
images into the 3D images, which apparatus and 
method are adapted to produce stereoscopic 
images even from the original 2D image signal rep- 40 
resenting still images. 

[2] There has already been developed an apparatus 
for providing a stereoscopic image by committing a 
signal to display on a 3D display unit, the signal rep- 
resenting a 3D image compost of a left-eye image 4s 
and a right-eye image having parallax therebe- 
tween. Furthermore, an apparatus for generating a 
3D image signal from a 2D image signal has 
already been developed. 

However, an apparatus has yef to be developed so 
which is adapted to perform a real-time processing 
on the 3D image signal for adjustment of a stereo- 
scopic effect of the 3D images produced from the 
3D image signal. 

It is. therefore, an object of the invention to pro- 55 
vide an apparatus and method for performing the 
real-time processing on the 3D image signal for 
adjustment of the stereoscopic effect of the 3D 



images produced from the 3D image signal. 
[3] There has been known a 2D/3D image converter 
which generates, from a 2D image, a first image 
signal used as a reference and a second image sig- 
nal time-delayed relative to the first image signal 
and outputs either one of these image signals as 
the left-eye image signal and the other as the right- 
eye image signal thereby converting the 2D image 
into the 3D image. 

[0003] As to the first image signal, the original 2D 
image signal is used as it is. A delay value of the second 
image signal relative to the first image signal depends 
upon a motion speed of an image represented the 2D 
image signal. The second image signal is generated in 
the following manner. 

[00041 More specifically, a predetermined number of 
fields of the 2D image signal inputted in the 2D/3D 
image converter, which precede the current field, are 
stored in a plurality of field memories on a field-by-field 
basis. Then, out of the 2D image signals stored in the 
respective field memories, read out is a 2D image signal 
having a delay value determined based on the motion 
speed of the image represented by the 2D image signal. 
The 2D image signal read out from the fieki memory is 
the second image signal. The left-eye and right-eye 
image signals thus obtained are each changed In rate to 
twice the normal rate in order to prevent the occurrence 
of flickers when the left-eye and right-eye images are 
viewed through a time division shutter glasses. 
[0005] Fig.55 diagrammatlcally illustrates a construc- 
tion of a prior-art 2D/3D image converter for generating 
a double-speed 3D image signal from the 2D image sig- 
nal. 

[0006] The 2D/3D image converter includes an inte- 
grated circuit (LSI) 1100 for converting the 2D image 
signal into the 3D image signal, a plurality of delay field 
memories 1200 connected to the integrated circuit 
1 100. and a doubling circuit 1300 for doubling frequen- 
cies of the left-eye and right-eye image signals output- 
ted from the integrated circuit 1 100. 
[0007] Fig.55 shows only components of the inte- 
grated drcuit 1100 that are involved in the writing of 
data to and the reading of data from the delay field 
memories 1200. More spedfically, the figure shows the 
components of the integrated circuit 1100, which 
include a write data path 1 101 , a write timing generating 
section 11 02. a read data path 1 103 and a read timing 
generating section 1104. Besides these components, 
the integrated circuit 1100 includes a motion vector 
sensing section, an interfoce connected to a CPU, and 
the like. 

[0008] The write timing generating section 1102 and 
the read timing generating section 1104 are each sup- 
plied with a reference clock signal CLK generated 
based on a horizontal synchronizing signal HSYNC of 
the 2D image signal, a vertical synchronizing signal 
VSYNC of the 2D image signal, and a horizontal syn- 
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chronizing signal HD generated based on the horizontal 
synchronizing signal Hsync as timed to the reference 
clock signal CUC. A frequency fcLK the reference 
clock signal CLK is given by the following equation (1) 
with fH denoting a frequency of the horizontal synchro- 
nizing signal HD: 

fcLK = 910fH (1) 

[0009] The integrated circuit (LSI) 1100 is supplied 
with a luminance signal (Y signal) and color difference 
signals (R-Y and B-Y signals) which three signals com- 
pose the 2D image signal. The integrated circuit 1100 
outputs the right-eye and left-eye image signals having 
a relative time difference therebetween. The right-eye 
image signal is composed of a right-eye luminance sig- 
nal Y(R) and right-eye color difference signals R-Y(R) 
and B-Y{R) whereas the left-eye image signal is com- 
posed of a left-eye luminance signal Y(L) and color dif- 
ference signals R-Y{L) and B-Y(L). 
[0010] Either one of the right-eye and left-eye image 
signals is generated from a signal of the 2D image sig- 
nal inputted in the integrated circuit 1100, which signal 
is sent to the read data path 1 1 03 via the write data path 
1 101 . The other of the right-eye and left-eye image sig- 
nals is generated from a signal of the 2D image signal 
inputted in the Integrated circuit 1100, which signal is 
sent to the read data path 1 103 via the write data path 
1 101 and the delay field memory 1200. 
[001 1 1 The Y R-Y and B-Y signals inputted in the write 
data path 1101 are written to the field memories 1200 
based on the reference signal CLK. Specifically, a dock 
frequency for writing to the delay field memories 1 200 is 
equal to the frequency fcLK *he reference dock signal 
CLK. 

[0012] The signals stored in the field memories 1200 
are read out based on the reference clock signal CLK. 
That is, a dock frequency for reading from the delay 
field memories 1200 is also equal to the frequency fQL^ 
of the reference clock signal CLK. 
[0013] Accordingly the right-eye luminance signal 
Y(R), the right-eye color difference signals R-Y(R) and 
B-Y(R), the left-eye luminance signal Y(L). and the left- 
eye color difference signals R-Y(L) and B-Y(L), which 
are outputted from the integrated circuit 1100. each 
have the same horizontal and vertical frequencies with 
the horizontal and vertical frequencies of the 2D image 
signals. 

[0014] The doubling drcuit 1300 includes double- 
speed field memories 1301-1306 for respectively stor- 
ing the right-eye luminance signal Y(R), the right-eye 
color difference signals R-Y(R) and B-Y(R), the left-eye 
luminance signal Y{L), and the left-eye color difference 
signals R-Y(L) arxJ B-Y(L). which are outputted from the 
integrated circuit 1100; a double-speed field-memory 
write timing generating circuit 1307 for controlling the 
writing of data to these double-speed field memories 
1 301 -1 306, and a dout)le-speed field-memory read tim- 



ing generating drcuit 1308 for controlling the reading of 
data from these double-speed field menx)ries 1301- 
1306. 

[0015] When the right-eye image signal Is read out, 
5 the right-eye luminance signal y(R) is read out from the 
double-speed field memory 1301 . the right-eye color dif- 
ference signal R-Y{R) is read out from the double-speed 
field memory 1302, and the right-eye color difference 
signal B-Y(R) Is read out from the double-speed field 
10 memory 1303. When the left-eye image signal is read 
out, the left-eye luminance signal Y(L) is read out from 
the double-speed field memory 1304, the left-eye color 
difference signal R-Y(L) is read out from the double- 
speed field memory 1305 and the left-eye color differ- 
15 ence signal B-Y(L) is read out from the double-speed 
field memory 1306. 

[0016] The reference clock signal CLK is applied as 
the writing dock to the double-speed field memories 
1301-1306 and the double-speed field-memory write 
timing generating circuit 1307. A clock signal CLKa with 
a frequency twice the frequency of the reference clock 
signal CLK is applied as the reading clock to the double- 
peed field memories 1301-1306 and the double-speed 
field-memory read timing generating circuit 1308. 
[001 7] As indicated by the following equation (2). a fre- 
quency fcLKa o1 the read clock signal CLKa is twice the 
frequency fcLK o1 tiie write clock signal CLK: 

*CLK = 2fcu< (2) 

[001 8] Thus, an image signal outputted from the dou- 
bling circuit 1300 has horizontal and vertical frequen- 
ces twice the horizontal and vertical frequendes of the 
2D Image signal. 

[0019] Fig.56 is a timing chart showing signals in 
respective parts of an arrangement wherein four delay 
field memories are provided and the left-eye image sig- 
nal is delayed relative to tiie right-eye image signal by 
two fields. 

[0020] The prior-art 2D/3D image converter requires 
the doubling circuit including the field memories for gen- 
erating the double-speed 3D image signal, thus suffer- 
ing high costs. 

[0021 1 It is therefore, an object of the invention to pro- 
vide a 2D/3D image converter which includes a reduced 
number of field memories from that of field memories in 
ttie prior-art image converter and hence, accomplishes 
the cost reduction. 

DISCLOSURE OF THE INVENTION 

[0022] A first apparatus for converting two-dimen- 
sional images into three-dimensional images according 
to the invention comprises characteristic value extract- 
ing means for extracting, from an inputted two-dimen- 
sional image signal, a perspective image characteristic 
value of each of plural parallax calculation regions 
defined in a one-field screen on a field-by-fietd basis; 
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parallax information generating means for generating 
parallax information on each of predetermined unit 
areas in the one-field screen by using the image charac- 
teristic value extracted per parallax calculation region; 
and phase control means for generating a first image 5 
signal and a second image signal from a signal of the 
inputted two-dimensional image signal which resides in 
each predetermined unit area, the first and second 
image signals having a horizontal phase difference ther- 
ebetween based on the parallax information related to /o 
the predetermined unit area. 

[0O23] For example, the parallax information generat- 
ing means includes means for generating perspective 
Image Information per parallax calculation region by 
using the perspective image charactenstic value of is 
each parallax calculation region; and means for con- 
verting the perspective Image information per parallax 
calculation region into parallax information per parallax 
calculation region. 

[0Q24] For example, tiie parallax information general- 20 
ing means includes means for generating perspective 
image information per parallax calculation region by 
using the perspective image characteristic value of 
each parallax calculation region; means for correcting a 
perspective image information piece on a parallax cal- 25 
culation region which is included in a group of parallax 
calculation regions located vertically lower in screen 
(hereinafter referred to as Vertical screen position") 
than a parallax calculation region having a perspective 
image information piece indicative of the neairest per- 30 
spective position and which has a perspective image 
information piece indicative of a perspective position a 
predetermined value or more farther from a perspective 
position indicated by a perspective image information 
piece on a parallax calculation region immediately 35 
thereabove. the perspective image information piece on 
the former parallax calculation region being corrected to 
indicate a perspective position closer to that indicated 
by the perspective image information piece on the latter 
parallax calculation region; and means for converting 40 
the corrected perspective image infonmatfon piece on 
each parallax calculation region into a parallax informa- 
tion piece on each parallax calculation region. 
[0025] For example, the parallax information generat- 
ing means includes first means for dividing all the paral- 45 
lax calculation regions in the one-field screen into 
groups associated witii respective objects included in 
the one-field screen by using the perspective image 
characteristic value of each parallax calculation region; 
second means for generating perspective image infor- so 
mation per group by using grouping results given by the 
first means and the perspective image characteristic 
value of each parallax calculation region; third means 
for generating perspective image information per paral- 
lax calculation region by using the perspective image ss 
information per group; and fourth means for converting 
the perspective image information per parallax calcula- 
tion re^on into parallax information per parallax calcula- 



tion region. 

[0026] The first means has the following features: 

(1) The first means is adapted to divide all the 
regions in the one-field screen into groups based 
on a histogram showing a number of parallax calcu- 
lation regions for each perspective characteristic 
value, each group including parallax calculation 
regions with perspective image characteristic val- 
ues close to one anotiier. 

(2) The first means includes means for dividing aJt 
the regions in the one-field screen into groups 
based on a histogram showing a number of parallax 
calculation regions tor each perspective image 
characteristic value, each group including parallax 
calculation regions witii perspective image charac- 
teristic values close to one another; and means 
which, when a single group includes a plurality of 
regions spatially separated from each other, divides 
tiie spatially separated regions into different 
groups. . 

(3) The first means includes means for dividing all 
the regions in the one-field screen Into groups 
based on a histogram showing a number of parallax 
calculation regions for each perspective image 
characteristic value, each group including parallax 
calculation regions witti perspective image charac- 
teristic values close to one another; means which, 
when a single group includes a plurality of regions 
spatially separated from each other, divides the 
spatially separated regions into different groups; 
and means which, when there is a group including 
a predetermined number of parallax calculation 
regions or fewer, checks perspective image charac- 
teristic values of the parallsix calculation regions of 
the group and parallax calculation regions adjacent 
to the groip to determine whether or not to com- 
bine the group with any one of neighboring groups, 
and combines the group with the neighboring group 
when the group is determined to be combined 
therewith. 

(4) The first means includes means for dividing all 
the regions of the one-field screen into groups 
based on a histogram showing a number of parallax 
calculation regions for each perspective image 
characteristic value, each group including parallax 
calculation regions witii perspective image charac- 
teristic values close to one another; means which, 
when a single group includes a plurality of regions 
spatially separated from each other, divides the 
spatially separated regions into different groups; 
means which, when tiiere is a group including a 
predetermined nunnber of parallax calculation 
regions or fewer, checks perspective image charac- 
teristic values of the parallax calculation regions of 
the group and parallax calculation regions adjacent 
to tiie group to determine whetiier or not to com- 
bine the groip with any one of neighboring groups, 
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and combines the group with the neighbonng group 
when the group is determined to be combined 
therewith: and means which checks perspective 
image characteristic values of parallax calculation 
regions of adjacent groups to determine whether to s 
combine them together or not, and combines the 
two groups together when they are deterrruned to 
be combined together. 

[0027] For example, the second means is adapted to io 
calculate the perspective image information on each 
group by using the perspective image characteristic 
value of each parallax calculation region of each group 
and a weighting factor previously defined for each paral- 
lax calculation region. is 
[0028] The third means has the following features: 

(1) The third means includes means for correcting a 
perspective image information piece on a parallcu 
calculation region which is included in a group of zo 
parallax calculation regions located vertically lower 

in screen than a parallax calculation region having 
a perspective image information piece indicative of 
the nearest perspective position and which has a 
perspective image information piece indicative of a 2S 
perspective position a predetermined value or more 
farther from a perspective position indicated by a 
perspective image Information piece on a parallax 
calculation region immediately thereabove, the per- 
spective image information piece on the former par- 30 
allax calculation region being corrected to indicate 
a closer perspective position to that Indicated by the 
perspective image information piece on the latter 
parallax calculation region. 

(2) The third means includes means for correcting a 3S 
perspective image information piece on a parallax 
calculation region which is included in a group of 
parallax calculation regions located vertically lower 

in screen than a parallax calculation region having 
a perspective image information piece indicative of 4o 
the nearest perspective position and which has a 
perspective image information piece indicative of a 
perspective position a predetermined value or more 
farther from a perspective position indicated by a 
perspective image information piece on a parallax 45 
calculation region immediately thereabove, the per- 
spective image information piece on tiie former par- . 
aOax calculation region being conrected to indicate 
a closer perspective position to that indicated by the 
perspective image information piece on tiie latter so 
parallax calculation region; and means for correct- 
ing perspective Image information pieces on 
respective pairs of parallax calculation regions 
included in adjacent groups and defining a bound- 
ary portion therebetween, tiiereby to limit a differ- ss 
ence between the perspective image information 
pieces on the respective pairs within a predeter- 
mined range. 



(3) The ttiird means includes means for correcting a 
perspective image information piece on a parallax 
calculation region which is included in a group of 
parallax calculation regions located vertically lower 
in screen than a parallax calculation region having 
a perspective Image information piece indicative of 
the nearest perspective position and which has a 
perspective image information piece indicative of a 
perspective position a predetermined value or more 
farther from a perspective position indicated by a 
perspective image information piece on a parallax 
calculation region immediately thereabove, tiie per- 
spective image information piece on tiie former par- 
allax calculation region being corrected to indicate 
a closer perspective position to that indicated by the . 
perspective image information piece on the latter 
parallax calculation region; means for correcting 
perspective image information pieces on respective 
pairs of parallax calculation regions included in 
adjacent groups and defining a boundary portion 
therebetween thereby to limit a difference between 
the perspective image information pieces on the 
respective pairs within a predetermined range; and 
means for smoothing perspective image informa- 
tion pieces on parallax calculation regions of the 
same group thereby to limit a difference in the per- 
spective image information pieces thereon within a 
predetermined range. 

[0029] For example, the phase control means includes 
first storage means having a capacity to store the two- 
dimensional image signal representing up to the 
number of pixels included in one horizontal line and 
temporarily storing the two-dimensional image signal; 
second storage means having a capacity to store the 
two-dimensional image signal representing up to the 
number of pixels included in one horizontal line and 
terrporarily storing the two-dimensional image signal; 
first read-address control means which controls a read 
address of the first storage means relatively to a stand- 
ard read address decided based on a horizontalA^ertical 
position of the inputted two-dimensional image signal 
according to the parallax information related to the pre- 
determined unit area including the horizontal/vertical 
position of the inputted two-dimensional image signal, 
thereby generating tiie first image signal a horizontal 
phase of which leads from a reference horizontal phase 
defined by said standard read address by a value based 
on said parallax information; and second read-address 
control means which controls a read address of the sec- 
ond storage means relatively to said standard read 
address according to tiie parallax information related to 
the predetermined unit area including the horizon- 
tal/vertical position of the inputted two-dimensional 
image signal, thereby generating the second image sig- 
nal a horizontal phase of which lags from the reference 
horizontal phase defined by said standard read address 
by a value based on said parallax information. 
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[0030] For example, the perspective image character- 
istic value is an optional one selected from the group 
consisting of luminance high-frequency component 
integration value, luminance contrast, luminance inte- 
gration value, R-Y component integration value, B-Y 5 
component integration value and chrome integration 
value or an optional combination of the above. The lumi- 
nance high-frequency component is meant to define 
high-frequency parts of frequency components of the 
luminance signal. The luminance contrast is meant to 10 
define intermediate-frequency parts of the frequency 
components of the luminance signal. The luminance 
integration value is meant to define a DC component of 
the frequency components of the luminance signal. The 
predetermined unit area is an area consisting of one is 
pixel, for example. 

[0O31] A method for converting two-dimensional 
images into three-dimensional images comprising the 
steps of a first step of extracting, from an Inputted two- 
dimensional image signal, a perspective image charac- 20 
teristic value of each of plural parallax calculation 
regions defined in a one-field screen on a f ield-by-f ieid 
basis; a second step of generating parallax information 
on each of predetermined unit areas in the one-field 
screen by using the image characteristic value 2s 
extracted per parallax calculation region; and a third 
step of generating a first image signal and a second 
image signal from a signal of the inputted two-dimen- 
sional image signal which resides in each predeter- 
mined unit area, the first and second image signals 30 
having a horizontal phase difference therebetween 
based on the parallax information related to the prede- 
termined unit area. 

[0O32] For example, the second step Includes a step 
of generating perspective image information on each 35 
parallax calculation region by using the perspective 
image characteristic value of each parallax calculation 
regpon; and a step of converting the perspective image 
information per parallax calculation region into parallax 
information per parallax calculation region. 40 
[0033] For example, the second step includes a step 
of generating perspective image information on each 
parallax calculation region by using the perspective 
image characteristic value of each parallax calculation 
region; a step of correcting a perspective image infer- 45 
matlon piece on a parallax calculation region which is 
included in a group of parallax calculation regions 
located vertically lower in screen than a parallax calcu- 
lation region having a perspective image information 
piece indicative of the nearest perspective position and so 
which has a perspective image information piece indic- 
ative of a perspective position a predetermined value or 
more farther from a perspective position indicated by a 
perspective image information piece on a parallax cal- 
culation region immediately thereabove. the perspective ss 
image information piece on the former parallax calcula- 
tbn region being corrected to indicate a closer perspec- 
tive position to tiiat indicated by the perspective image 



information piece on the latter parallax calculation 
region; and a step of converting the corrected perspec- 
tive image information piece on each parallax calcula- 
tion region into parallax information piece on each 
parallax calculation region. 

[0034] For example, the third step includes a step of 
temporarily storing tiie inputted two-dimensional image 
signal in first storage means and second storage 
means, each storage means capable of storing the 
inputted two-dimensional image signal representing up 
to the number of pixels included in one horizontal line; a 
step of controlling a read address of the first storage 
means relatively to a standard read address decided 
based on a horizontal/vertical position of the inputted 
two-dimensional image signal according to parallax 
information related to a predetenmined unit area includ- 
ing the horizontalA^ertical position of the inputted two- 
dimensional image signal, thereby generating the first 
Image signal a horizontal phase of which leads from a 
reference horizontal phase defined by said standard 
read address by a value based on said parallax informa- 
tion; and a step of controlling a read address of the sec- 
ond storage means relatively to said standard read 
address according to the parallax information related to 
the predetermined unit area including the horizon- 
tal/vertical position of the inputted two-dimensional 
image signal, thereby generating the second inrage sig- 
nal a horizontal phase of which lags from the reference 
horizontal phase defined by said standard read address 
by a value based on said parallax information. 
[0035] As the perspective image characteristic value, 
there is used an optional one selected from the group 
consisting of luminance high-frequency component 
integration value, luminance contrast, luminance inte- 
gration vailue and chroma integration value or an 
optional combination of the above. Specifically, tiie lumi- 
nance high-frequency component integration value may 
be used as the perspective image characteristic value. 
Otherwise, the luminance contrast may be used as \he 
perspective image characteristic value. A combination 
of tiie luminance high-frequency component integration 
value and the luminance contrast may be used as tiie 
perspective image characteristic value. Alternatively, a 
combination of the luminance high-frequency compo- 
nent integration value, the luminance contrast and the 
luminance integration value may be used as the per- 
spective image characteristic value. Furttier, a combina- 
tion of the luminance high-frequency component 
integration value, tiie luminance contrast and the 
chroma integration value may be used as the perspec- 
tive image characteristic value. Alternatively, a combina- 
tion of the luminance high-frequency component 
integration value, the luminance contrast, the luminance 
integration value and the chroma integration value may 
be used as the perspective image characteristic value. 
[0036] The predetermined unit area consists of one 
pixel, for example. 

[0037] A second apparatus for converting two-dimen- 
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sional images into three-dimensional images according 
to the invention comprises motion vector sensing 
means for sensing, from an inputted two-dimensional 
image signal, a motion vector of each of plural motion- 
vector detection regions defined in a one-field saeen on 5 
a field-by-field basis; parallax information generating 
means for generating parallax information on each pre- 
determined unit area in the one-field screen by using a 
horizontal con^onent of the motion vector sensed per 
motion-vector detection region; and phase control 10 
means for generating a first image signal and a second 
image signal from a signal of the inputted two-dimen- 
sionat image signal which resides in each predeter- 
mined unit area, the first and second image signals 
having a horizontal phase difference therebetween 15 
based on parallax information related to the predeter- 
mined unit area, 

[0038] For exanrple. the parallax information generat- 
ing means is adapted to generate the parallax informa- 
tion per predetermined unit area of the one-field screen 20 
based on a horizontal component of the motion vector 
sensed per motion-vector detection region, a maximum 
horizontal component value, a motion vector detection 
region presenting the maximum horizontal component 
value, a minimum horizontal component value, a 25 
motion-vector detection region presenting the minimum 
horizontal component value, and information indicative 
of whether an image corresponding to each motion-vec- 
tor detection region represents an object or a back- 
ground. 30 
[0039] For example, the phase control means includes 
first storage means having a capacity to store the input- 
ted two-dimensional image signal representing up to the 
number of pixels included in one horizontal line and 
tenporarily storing the inputted two-dimensional image 3S 
signal; second storage means having a capacity to 
store the inputted two-dimensional image signal repre- 
senting up to the number of pixels included in one hori- 
zontal line and temporarily storing the inputted two- 
dimensional image signal; first read-address control 40 
means which controls a read address of the first storage 
means relatively to a standard read address decided 
based on a horizontalA^ertical position of the inputted 
two-dimensional image signal according to parallax 
information on a predetermined unit area including the 4S 
horizontal/vertical position of the inputted two-dimen- 
sional image signal, thereby generating the first image 
signal a horizontal phase of which leads from a refer- 
ence horizontal phase defined by said standard read 
address by a value based on said parallax information; so 
and second read-address control means which controls 
a read address of the second storage means relatively 
to said standard read address according to the parallax 
information on the predetermined unit area including 
the horizontal/vertical position of the inputted two- ss 
dimensional image signal, thereby generating the sec- 
ond image signal a horizontal phase of which lags from 
the reference horizontal phase defined by said standard 



read address by a value based on said parallax informa- 
tion. 

[0040] The predetermined unit area is an area con- 
sisting of one pixel, for example. 
[0041] A second method for converting two-dimen- 
sional images into three-dimensional images according 
to the invention comprises the steps of a first step of 
sensing, from an inputted two-dimensional image sig- 
nal, a motion vector of each of plural motion-vector 
detection regions defined in a one-field screen on a 
field-by-field basis; a second step of generating parallax 
information on each predetermined unit area in the one- 
field screen by using a horizontal component of the 
motion vector sensed per motion-vector detection 
region: and a third step of generating afirst image signal 
and a second image signal from a signal of the inputted 
two-dimensional image signal which resides in each 
predetermined unit area, the first and second image sig- 
nals having a horizontal phase difference therebetween 
based on parallax information related to the predeter- 
mined unit area. 

[0042] In the second step, for example, the parallax 
information is generated per predetermined unit area of 
the one-field screen by using a horizontal component of 
the motion vector sensed per motion-vector detection 
region, a maximum horizontal component value, a 
motion-vector detection region presenting the maximum 
horizontal component value, a minimum horizontal com- 
ponent value, a motion-vector detection region present- 
ing the minimum horizontal component value, and 
information indicative of whether an image correspond- 
ing to each motion-vector detection region represents 
an object or a background. 

[0043] For example, the third step includes a step of 
temporarily storing tiie inputted two-dimensional image 
signal in first storage means and second storage 
means, each storage means having a capacity to store 
the inputted two-dimensional image signal representing 
up to the number of pixels included in one horizontal 
line: a step of controlling a read address of the first stor- 
age means relatively to a standard read address 
decided based on a horizontal/vertical position of the 
inputted two-dimensional image signal according to par- 
allax information related to a predetermined unit area 
including the horizontal/vertical position of the inputted 
two-dimensbnal image signal, thereby generating the 
first image signal a horizontal phase of which leads from 
a reference horizontal phase defined by said starKlard 
read address by a value based on tine parallax informa- 
tion; and a step of controlling a read address of the sec- 
ond storage means relatively to said standard read 
address according to the parallax information related to 
the predetermined unit area including tiie horizon- 
tal/vertical position of the inputted two-dimensional 
image signal, thereby generating the second image sig- 
nal a horizontal phase of which lags from the reference 
horizontal phase defined by said standard read address 
by a value based on said parallax information. 
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[0O44] The predetermined area consists of one pixel, 
for example. 

[0O45] A first stereoscopic effect adjusting method lor 
adjusting a stereoscopic effect of a tree-dimensional 
Image according to the invention is characterized by s 
controlling a sharpness of an image contour per prede- 
termined unit area of the three-dimensional image 
according to perspective image information on each 
predetermined unit area of a one-f lefd screen displaying 
the three-dimensional image. The predetermined area io 
consists of one pixel, for example. 
[0046] More specifically, the sharpness of the image 
contour is controlled such that an area representing a 
near-view image is Increased in the sharpness of the 
image contour while an area representing a distant-view is 
image is decreased in the sharpness of the image con- 
tour. This enhances the stereoscopic effect of the repro- 
duced image because the human eye perceives the 
nearer object in the sharper outline and the more distant 
object in the more blurr^ outline. 20 
[0047] A second stereoscopic effect adjusting meUiod 
for adjusting a stereoscopic effect of a three-dimen- 
sional image according to the invention is characterized 
by controlling a chroma per predetermined unit area of 
the three-dimensional image according to perspective 2s 
image information on each predetermined unit area of a 
one-field screen displaying the three-dimensional 
image. The predetermined unit area consists of one 
pixel, for example. 

[0048] More specifically, the chroma of the image is 30 
controlled such that an area representing a near-view 
image is increased in the image chroma while an area 
representing a distant-view image is decreased in the 
image chroma. This enhances the stereoscopic effect of 
the reproduced image because the human eye per- 3S 
ceives the nearer object in the more vivid colors and the 
more distant object in the paler colors. 
[0049] A third stereoscopic effect adjusting method for 
adjusting a stereoscopic effect of a three-dimensional 
image according to the invention is characterized by 40 
controlling a sharpness of an image contour and a 
chroma per predetermined unit area of the three-dimen- 
sional image according to perspective image informa- 
tion on each predetermined unit area of a one^ield 
screen displaying the three-dimensional image. The 45 
predetermined unit area consists of one pixel, for exam- 
ple. 

[0050] More specifically, tiie sharpness of the image 
contour is controlled such that an area representing a 
near-view image is increased in the sharpness of the so 
image contour while an area representing a distant-view 
image is decreased in the sharpness of the image con- 
tour and that the area representing the near-view image 
is increased in the image chroma while the area repre- 
senting tiie distant-view image is decreased in the ss 
image chroma. This enhances the stereoscopic effect of 
the reproduced image because the human eye per- 
ceives the nearer object in the sharper outiine and the 



more vivid colors but tiie more distant object in the more 
blurred outiine and the paler colors. 
[0051 ] A first stereoscopic effect adjusting apparatus 
comprises image contour controlling means for control- 
ling a sharpness of an image contour per predeter- 
mined unit area of a three-dimensional image according 
to perspective image information on each predeter- 
mined unit area of a one-field screen displaying the 
three-dimensional image. The predetermined unit area 
is an area consisting of one pixel, for example. 
[0052] For example, the image contour controlling 
means is adapted to control the sharpness of image 
contour such that an area representing a near-view 
image is increased in the sharpness of image contour 
while an area representing a distant-view image is 
decreased in the sharpness of image contour. This 
enhances the stereoscopic effect of the reproduced 
image because the human eye perceives the nearer 
object in the sharper outiine but the more distant object 
in the more blun-ed outiine. 

[0053] A specific example of the image contour con- 
trolling means is adapted to decrease a ratio of a low- 
frequency component and to increase a ratio of a high- 
frequency component of the three-dimensional image 
signal in an area representing a near-view image, and 
to increase a ratio of the low-frequency component and 
to decrease a ratio of the high-frequency component of 
the three-dimensional image signal in an area repre- 
senting a distant-view image. 

[0054] A second stereoscopic effect adjusting appara- 
tus according to the invention comprises chroma con- 
trolling means for controlling a chroma of each 
predetermined unit area of a three-dimensional image 
according to perspective image information on each 
predetermined unit area of a one-field screen displaying 
the three-dimensional image. The predetermined unit 
area is an area consisting of one pixel, for example. 
[0055] For example, the chroma controlling means is 
adapted to control the image chroma by increasing an 
image chroma of an area representing a near-view 
image arKi by decreasing an image chroma of an area 
representing a distant-view image. This enhances the 
stereoscopic effect of the reproduced image because 
the human eye perceives the nearer object in the more 
vivid colors but tiie more distant object in the paler 
colors. 

[0056] A third stereoscopic effect adjusting apparatus 
according to the invention comprises image contour 
controlling means for controlling a sharpness of an 
image contour per predetermined unit area of a three- 
dimensional image according to perspective image 
information oh each predetermined unit area of a one- 
field screen displaying the three-dimensional image; 
and chroma controlling means for controlling a chroma 
per predetermined unit area of the three-dimensional 
image according to the perspective image information 
on each predetermined unit area of the one-field screen 
displaying the three-dimensional image. The predeter- 
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mined unit area Is an area consisting of one pixel, for 
example. 

[0057] For example, the image contour controlling 
means is adapted to control the sharpness of the image 
contour by increasing a sharpness of an image contour 
related to an area representing a near- view image and 
by decreasing a sharpness of an image contour related 
to an area representing a distant-view image, whereas 
the chronia controlling means is adapted to control the 
image chroma by increasing a chroma of the area rep- 
resenting the near-view image and by decreasing a 
chroma of the area representing the distant-view image. 
[0058] This enhances the stereoscopic effect of the 
reproduced image because the human eye perceives 
the nearer object in the sharper outline and the more 
vivid colors but the more distant object in the more 
blunged outline and the paler colors. 
[0059] For example, the image contour controlling 
means is adapted to decrease a ratio of a low-frequency 
component and increase a ratio of a high-frequency 
component of the three-dimensional irrage signal in an 
area representing a near-view image, and to increase a 
ratio of the low-frequency component and decrease a 
ratio of the high-frequency component of the three- 
dimensional image signal in an area representing a dis- 
tant-view image. 

[0060] A two-dimensional/three-dimensional image 
converter according to the invention comprises a plural- 
ity of field memories serving to store a predetermined 
number of fields of an inputted two-dimensional image 
signal which are earlier than the current field, and 
means for reading, from the plural field memories, 
respective pairs of image signals having a relative time 
difference therebetween and oulputtrng one of the 
image signal pair as a left-eye image signal and the 
other as a right-eye image signal, the two-dimen- 
sional/three-dimensional image converter wherein a 
read clock for each field memory has a frequency set to 
twice the frequency of a write clock for the field memory. 
[0061] Since the read clock for each field memory is 
set to twice the frequency of the write dock for the field 
memory, the left-eye image signal or the right-eye 
image signal read from each field memory has a hori- 
zontal frequency and a vertical frequency which are 
each twice the frequency of the two-dimensional image 
signal. 

BRIEF DESC RIPTION OF THE DRAWINGS 
[0062] 

Fig.1 is a block diagram showing an exemplary 
whole construction of a 2Dy3D image conversion 
apparatus according to the invention; 
Rg.2 is a schematic diagram showing parallax cal- 
culation regions; 

Rg.3 is a block diagram showing a configuration of 
a luminance integrating circuit; 



Rg.4 is a block diagram showing a configuration of 
a high-frequency component integrating circuit; 
Rg.5 is a drcuit diagram showing an exemplary 
configuration of a high-pass filter 232 in Rg.4; 

5 Rg.6 is a graphical representation of input/output 

characteristics of a slicing circuit 234 in Fig.4; 
Rg.7 is a block diagram showing another ^cem- 
plary configuration of the high-frequency compo- 
nent integrating drcuit: 

10 Rg.8 is a drcuit diagram showing an exemplary 
configuration of a peak detecting circuit 239 in 
Rg.7; 

Rg.9 is a timing chart showing signals in respective 
parts of the peak detecting drcuit 239; 

IS Rg.1 0 is a block diagram showing a configuration of 
a luminance contrast calculating circuit; 
Rg.1 1 is a circuit diagram showving a configuration 
of a luminance contrast sensing circuit in Fig. 10; 
Rg.1 2 is a drcuit diagram showing a configuration 

20 of a chroma integrating circuit; 

Rg.1 3 is a block diagram illustrating a parallax infor- 
mation generating procedure taken by a CPU; 
Rg.1 4 is a graphical representation of a relation 
between input and output of normalizing means 

25 410inRg.13; 

Rg.15 is a schematic diagram showing parallax cal- 
culation regions actually defined; 
Rg.1 6 is a schematic diagram sliowing one exam- 
ple of depth information on the respective parallax 

30 calculation regions prior to a depth correction 
processing; 

Rg.1 7 is a schematic diagram showing corrected 
depth information on the respective parallax calcu- 
lation regions; 

35 Rg.1 8 is a graphical representation of a relation of 
the depth information versus vertical screen posi- 
tion prior to the depth correction processing and a 
relation of the corrected depth information versus 
the vertical screen position; 

40 Rg.1 9 is a graphical represeritation of a relation 
between ttie depth information and parallax infor- 
mation; 

Rg.20 is a block diagram showing essential config- 
urations of a parallax control drcuit afKl optional 

45 pixel delays FIFOs; 

Rg.21 is a schematic diagram showing relative hor- 
izontal positions and relative vertical positions; 
Rg.22 is a schematic diagram illustrating a method 
of generating parallax information on a target pixel; 

50 Rgs.23a-23d are tables showing selection rules fol- 
lowed by a parallax selection drcuit; 
Rg.24 is a timing chart showing signals in respec- 
tive parts in a case where parallax information=0; 
Rg.25 is a block diagram showing a configuration of 

55 the parallax conti'ol circuit with values appended to 
respective addresses in a case where parallax 
infbrmation=1 .2; 

Rg.26 is a timing chart showing signals in the 
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respective parts in a case where parallax informa- 

tion=1.2; 

Fig.27 is a block diagram showing an exemplary 
whole construction of a 2D/3D image conversion 
apparatus according to the invention; s 
Rg.28 is a flow chart representing steps in a paral- 
lax information generating procedure taken by the 
CPU; 

Fig.29 Is a histogram representing parallax calcula- 
tion regions (in number) with respect to respective io 
normalized values of high-frequency component 
integration values; 

Fig.30 is a schematic diagram showing a result of a 
grouping processing based on the histogram of 
Fig.29; is 
Fig.31 is a graphical representation of a parallax 
calculation region distribution wherein the normal- 
ized values of R-Y component integration values 
are plotted as ordinate while the normalized values 
of B-Y component integration values are plotted as 20 
abscissa; 

Fig.32 is a schematic diagram showing a result of 
the grouping processing based on the graph of 
Fig.31 ; 

Fig.33 is a schematic diagram showing the result of 25 
the grouping processing based on the graph of 

Fig.31; 

Fig. 34 is a schematic diagram showing a result of 
the grouping processing corrected through a spatial 
separation processing; 30 
Rg.35 is a schematic diagram illustrating a singulsur 
point processing; 

Fig. 36 is a schematic diagram showing a result of 
the grouping processing corrected through the sin- 
gular point processing; 35 
Fig.37 is. a schematic diagram showing background 
weight connponents previously defined for the 
respective parallax calculation regions; 
Fig. 38 is a schematic diagram showing one exam- 
ple of depth information on the respective parallax 40 
calculation regions prior to a depth correction 
processing; 

Fig.39 is a schematic diagram showing corrected 
depth information on the respective parallax calcu- 
lation regions; 45 
Fig.40 Is a graphical representation of a relation of 
the depth information versus vertical screen posi- 
tion prior to the depth correction processing and a 
relation of the corrected depth information versus 
the vertical screen position; so 
Fig.41 is a schematic diagram illustrating an in- 
group depth Information correction processing; 
Rg.42 is a graphical representation of a relation 
between the depth information and pareillax irtfor- 
mation; ss 
Fig. 43 is a trfock diagram showing an exemplary 
whole construction of a 2D/3D image conversion 
apparatus according to the invention; 



Rg.44 is a functional block diagram illustrating a 
parallax information generating procedure taken by 
tiie CPU; 

Rg.45 is a schematic diagram illustrating the paral- 
lax information generating procedure takari by the 
CPU; 

Rg.46 is a block diagram showing a construction of 
a 2D/3D image conversion system according to the 
invention; 

Rg.47 is a block diagram showing a configuration of 
a stereoscopic effect adjusting circuit; 
Rg.48 is a graphical representation of a relation 
between parallax information PR per pixel and a 
first factor KL; 

Rg.49 is a graphical representation of a relation 
between the parallax information PR per pixel and a 
second factor KH; 

Rg.50 is a graphical representation of a relation 
between the parallax information PR per pixel and a 
tiiird foctor KC; 

Rg.51 is a block diagram showing a construction of 
a stereoscopic effect adjusting system; 
Rg.52 is a block diagram showing a construction of 
a 2D/3D image converter according to the inven- 
tion; 

Rg.53 is an electrical circuit diagram showing a 
configuration of a phase synchronizing circuit for 
generating a first reference dock CLK and a first 
horizontal synchronizing signal HD1 ; 
Rg.54 is a timing chart showing signals in respec- 
tive parts of Rg.51 in a double speed conversion 
mode as a mode of converting the 2D image into 
the 3D image; 

Rg.55 is a block diagram showing a construction of 
a prior-art 2D/3D image converter for generating a 
double-speed 3D image signal from the 2D image 
signal; and 

Rg.56 is a timing chart showing signals in respec- 
tive parts in Rg.55. 

MOST PREFERRED MODE FOR CARRYING OUT 
THE INVENTION 

[1] Rrst Embodiment 

[0063] Now referring to Figs.1 to 26, a first embodi- 
ment of the invention will bie described. 
[0064] Fig. 1 is a block cfiagram showing a whole con- 
struction of a 2D/3D image conversion apparatus for 
converting two-dimensional images into tiiree-dimen- 
sional images. 

[0065] A luminance signal Y and color difference sig- 
nals R-Y and B-Y which compose a 2D image signal are 
respectively converted into a digital Y signal, R-Y signal 
and B-Y signal by an AD conversion circuit 1 (ADC). 
[0066] The Y signal is si4>plied to a luminance inte- 
grating circuit 7. a high-frequency component integrat- 
ing circuit 8 and a luminance contrast calculating circuit 
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9 as well as to a first left-eye-image optional pixel delay 
FIFO 1 1 and a first right-eye-image optional pixel delay 
FIFO 21 . The R-Y signal is supplied to a chroma inte- 
grating circuit 10 as well as to a second left-eye-image 
optional pixel delay FIFO 12 and a second right-eye- s 
image optional pixel delay FIFO 22. The B-Y signal is 
supplied to the chroma integrating circuit 10 as well as 
to a third left-eye-image optional pixel delay FIFO 13 
and a third right-eye-image optional pixel delay FIFO 
23. 10 
[0067] As shown in ng.2. the luminance integrating 
circuit 7 calculates a luminance integration value of 
each of plural parallax calculation regions El -El 2 previ- 
ously defined in a one-field screen on a field-by-field 
basis. The high-frequency component integrating circuit is 
8 calculates a high-frequency component integration 
value of each of the parallax calculation regions E1-E12 
on a fieid-by-field basis. The luminance contrast calcu- 
lating circuit 9 calculates a luminance contrast of each 
of the parallax calculation regions El -E12 on a field-by- 20 
field basis. The chroma integrating circuit 10 calculates 
a chroma integration value of each of the parallax calcu- 
lation regions E1 -E12 on a f ield-by-fieid basis. 
[0068] A perspective image characteristic value of 
each parallax calculation region El -El 2 includes the ss 
luminance integration value of each parallax calculation 
region E1-E12, the high-frequency component integra- 
tion value of each parallax calculation region E1-E12. 
the luminance contiBst of each parallax calculation 
region E 1 -El 2 and the chroma integration value of each 30 
parallax calculation region El -El 2. 
[0069] It should be understood tiiat the one-field 
screen actually includes a total of 60 parallax calcula- 
tion regions F1-F60 in an arrangement of 6 rows and 10 
columns, as shown in Fig. 1 5. However, it is assumed for 3S 
easy reference purposes that a total of 12 parallax cal- 
culation regions El -El 2 in an arrangement of 3 rows 
and 4 columns are defined in a one-field screen, as 
shown in Fig. 2. 

[0070] A CPU 3 generates parallax information on the 40 
respective parallax calculation regions El -El 2 based 
on information supplied from the luminance integrating 
circuit 7, the high-frequency component integrating dr- 
cuit 8, luminance contrast calculating drcuit 9 and 
chroma integrating drcuit 10. In this example, the paral- 45 
lax information is generated such that an image corre- 
sponding to an object located the more to the front, like 
a subject of a scene, has the smaller parallax value 
while an image corresponding to an object located the 
more to the bacK like a background of the scene, has so 
the greater parallax value. A method of generating the 
parallax information will hereinafter be described in 
detail. 

[0071 ] The parallax information per parallax calcula- 
tion region El -E12 thus given by the CPU 3 is sent to a ss 
parallax control drcuit 4. The parallax conti'ol circuit 4, in 
turn, generates parallax information per pixel position In 
each field based on the parallax information on each 



parallax calculation region E1-E12. Based on the paral- 
lax information per pixel position, the parallax control 
drcuit 4 conti-ols read addresses of FIFOs 11-13 and 
21-23 to read tfie image signal (Y. R-Y and B-Y signals) 
tiierefrom such tiiat tine read addresses of FIFOs 11-13 
are shifted from those of FIFOs 21-23, respectively. 
Hence, the left-eye image signal read out from the left- 
eye-image optional pixel delays FIFOs 11-13 has a dif- 
ferent horizontal phase from that of the right-eye image 
signal read out from the right-eye-image optional pixel 
delays FIFOs 21-23. 

[0072] The left-eye image signal (YL signal, (R-Y)L 
signal and (B-Y)L signal) read out from the left-eye- 
image optional pixel delays FIFOs 11-13 is converted 
into an analog signal by a DA conversion circuit (DAC) 5 
and then supplied to an unillustrated three-dimensional 
display unit. The right-eye iniage signal (YR signal. (R- 
Y)R signal and (B-Y)R signal) read out from the right- 
eye-image optional pixel delays FIFOs 21-23 is con- 
verted into an analog signal by a DA conversion circuit 
(DAC) 6 and then supplied to the unillustrated three- 
dimensional display unit. 

[0073] Since the left-eye image signal has a different 
horizontal phase from that of the right-eye image signal, 
a parallax is produced between the left eye image and 
the right eye image. Hence, by viewing the left eye 
image with the left eye alone and the right eye image 
with the right eye alone, a three-dimensional image is 
established wherein the subject is located to the front 
agairist the background. 

[0074] Rg.3 diagrammatically illustrates a configura- 
tion of the luminance integrating circuit 7. 
[0075] There are shown horizontal addresses (HAD) 
and vertical addresses (VAD) of the respective parallax 
calculation regions El -El 2 in Fig.2 wherein "m" repre- 
sents a nurhber of horizontal pixels of each parallax cal- 
culation region E1-E12. "n" represents a number of 
vertical pixels of each parallax calculation region, and 
(a, b) represents coordinates of an upper left vertex of a 
first parallax calculation region El . 
[0076] The luminance integrating circuit 7 indudes a 
timing signal generating circuit 201. an adder drcuit 
202, a luminance integration register group 203 and a 
selection circuit (SEL) 204. The luminance integration 
register group 203 includes first to twelfth luminance 
integration registers 211-222 corresponding to tiie 
respective parallax calculation regions El -El 2. 
[00771 The timing signal generating drcuit 201 is sup- 
plied with a horizontal synchronizing signal Hsync and a 
vertical synchronizing signal Vsync of an input image 
signal, and aclock signal CUCfordetection of a horizon- 
tal address of each horizontal period. 
[0078] The timing signal generating drcuit 201 serves 
to output first to twelfth enable signals EN1-EN12. a 
reset signal RST and an output timing signal DOUT 
based on the horizontal synchronizing signal Hsync. 
vertical synchronizing signal Vsync and clock signal 
CLK. 
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[0079] The enable signals EN1-EN12 correspond to 
the parallax calculation regions E1-E12, respectively, 
and are normally at L level, rising to H level when the 
horizontalA/ertical position of the input image signal is in 
a region corresponding thereto. The first to twelfth ena- 5 
ble signals EN1 -En12 are inputted in first to twelfth lumi- 
nance Integration registers 211-222 as a write signal, 
respectively. The first to twelfth enable signals EN1- 
EN12 are supplied to the selection circuit 204, as well. 
The selection circuit 204 selectively outputs input data 10 
in correspondence to any one of the enable signals that 
is at H level. 

[0O8O] The reset signal RST is outputted as timed to 
a start of a valid image of each field of the Input image 
signal and is supplied to the respective luminance inte- is 
gration registers 211-222. Responding to the inputted 
reset signal RST, the luminance Integration registers 
21 1 -222 each have a content thereof reset to 0. 
[0081] As shown in Rg.2, the timing signal DOUT is at 
H level during a given period of time starting from when 20 
the vertical position of the Input image signal passes a 
vertically lowermost position of the parallax calculation 
region El 2 in the lowest row. The output timing signal 
DOUT is sillied to the CPU 3. 

[0082] The reset signal is outputted as timed to tine 25 
start of the valid image of the input image signal for 
resetting tiie contents of the respective luminance Inte- 
gration registers 211-222 to 0. Where the horizon- 
tal/vertical position of the input image signal is in the 
first parallax calculation region El, the first enable sig- 30 
nal EN1 rises to H level, so that a luminance value 
retained by the first luminance Integration register 21 1 is 
supplied to the adder circuit 202 via the selection circuit 
204 white the Y signal of the input image signal is 
applied to the adder circuit 202. 3s 
[0083] Accordingly, the lunrtinance value retained by 
the first luminance integration register 211 and the Y 
signal of the input image signal are added together by 
the adder circuit 202. A reailtant sum is stored in the 
first luminance integration register 211. That is. when 40 
the horizontalA^ertical position of the input image signal 
Is in the first parallax calculation region El. luminance 
values of the pixels in the first parallax calculation region 
El are sequentially integrated while the Integration 
results are accordingly stored in the first luminance inte- 45 
gration register 211. 

[0084] In this manner, the luminance integration val- 
ues of the respective parallax calculation regions E1- 
E12 are stored in the corresponding luminance integra- 
tion registers 211-222. When the output timing signal so 
DOUT rises to H level, the luminance integration values 
stored in the respective luminance integration registers 
211-222 in conrespondence to the parallax calculation 
regions El -El 2 are supplied to the CPU 3 via a data 
bus (DATA-BUS). 55 
[0085] Rg.4 diagrammatically illustrates a configura- 
tion of the high-frequency component integrating circuit 
8. The high-frequency component integrating circuit 8 



includes a timing signal generating circuit 231, a high- 
pass filter (HPF) 232, an absolutizing circuit 233, a slic- 
ing circuit 234. an adder circuit 235. a high-frequency 
component integration register group 236 and a selec- 
tion circuit 237. The high-frequency component integra- 
tion register group 236 includes first to Iwelftii high- 
frequency component integration registers 241-252 in 
correspondence to the parallax calculation regions E1- 
E12. 

[0086] Input and output signals of tiie timing signal 
generating circuit 231 are tiie same with those of tiie 
timing signal generating circuit 201 shown in Fig.3. 
[0087] As shown in Fig.5. for example, the high-pass 
filter 232 includes five D flip-flops 261 -1 65. a bit shift cir- 
cuit 266 for providing an output at twice tiie value of an 
input value, an adder 267 and a subtracter 268, and 
have tap factors of -1 . 0, 2, 0 and -1 . 
[0088] The slicing circuit 234 may have input/output 
characteristics shown in Fig.6. The circuit Is adapted to 
provide an output of 0 with respect to an input in a range 
of between 0 and la in order to prevent noises from 
being extracted as a high-frequency component. 
[0089] Thus, the high-pass filter 232 extracts a high- 
frequency component of Y signal of the input image sig- 
nal, an absolute value of which component is obtained 
by the absolutizing circuit 233 and from which compo- 
nent noises are removed by the slicing circuit 234. 
[0090] The reset signal is outputted as timed to the 
start of a valid image of the input image signal so as to 
reset contents of the high-frequency component inte- 
gration registers 241-252 to 0. Where the horizon- 
tat/vertical position of the input image signal is in the 
first parallax calculation region E1. the first enable sig- 
nal EN1 rises to H level so that the high-frequency com- 
ponent retained by the first high-frequency component 
integration register 241 is supplied to the adder circuK 
235 via tiie selection circuit 237 while the high-fre- 
quency component of Y signal (or the output from tiie 
slicing circuit 234) of the input image signal is supplied 
to the adder circuit 235. 

[0091 ] Thus, the high-frequency component retained 
by the first high-frequency component integration regis- 
ter 241 and that of Y signal of the input image signal are 
added together by the adder circuit 235. A resultant sum 
is stored in the first high-frequency component integra- 
tion register 241. That is, when tiie horizontalA^ertical 
position of tiie Input image signal is in the first parallax 
calculation region El, high-frequency components of 
the pxels in the first parallax calculation region El are 
sequentially integrated while integration results are 
accordingly stored in the first high-frequency compo- 
nent Integration register 241 . 

[0092] In this manner, high-frequency component inte- 
gration values of tiie respective parallax calculation 
regions El -El 2 are stored in the corresponding high- 
frequency component integration registers 241-252. 
When the output timing signal DOUT rises to H level, 
the high-frequency component integration values stored 
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in the respective high-frequency component integration 
registers 241 -252 In con-espondence to the parallax cal- 
culation regions El -E12 are supplied to the CPU 3 via a 
data bus. 

[0093] Fig.7 diagrammatically illustrates another 
exemplary configuration of the high-frequency compo- 
nent integration circuit 8. 

[0094] This high-frequency component integration dr- 
cuit 8 includes a timing signal generating circuit 238, the 
high-pass filter 232, a peak detecting circuit 239, the 
adder circuit 235, the high-frequency component inte- 
gration register group 236 and the selection circuit 237. 
[0095] The timing signal generating drcuit 238 oper- 
ates substantially the same way with the timing signal 
generating drcuit 201 of Fig.3 except for that a trigger 
pulse (region boundary signal RST1 ) is outputted when 
the input image signal reaches a horizontal position 
immediately before the parallax calculation region El, 
E5 or E9 and the last horizontal position of each paral- 
lax calculation region E1-E12, as shown in Fig.2. The 
region boundary signal RST1 is supplied to the peak 
detecting circuit 239. 

[0096] The high-frequency component of Y signal 
extracted by the high-pass filter 232 is suf>plied to the 
peak detecting drcuit 239. The peak detecting drcuit 
239 detects the maxirnum value of the high-frequency 
components for each horizontal line of each parallax 
calculation region E1-E12. The peak detecting circuit 
239 may indude a comparison drcuit 271, a maximurh 
value register 272 and a gate 273, as shown in Fig.8. 
Rg.9 is a timing chart showing the horizontal synchro- 
nizing signal Hsync. the region boundary signal RST1 
and an output from the gate 273. 
[0097] The maximum value register 272 Is supplied 
with the high-frequency component of Y signal 
extracted by the high-pass filter 232, the region bound- 
ary signal RST1 . a judgment signal La from the compar- 
ison circuit 271 and the clock signal CLK. The 
comparison drcuit 271 compares the output from the 
maximum value register 272 and the high-frequency 
component of Y signal of the input image signal so as to 
raise the judgment signal La to H level when determin- 
ing the high-frequency component of Y signal to be 
greater than the output from the hnaximum value regis- 
ter 272. 

[0098] Rising to H level, tiie region boundaty signal 
RST1 resets a content of the maximum value register 
272 to 0. If the judgment signal La from the comparison 
circuit 271 is at H level while the region boundary signal 
RST1 is at L level, the high-frequency component of Y 
signal is stored in the maximum value register 272. That 
is, the content of the maximum value register 272 is 
updated. Thus, in each period during which the region 
boundary signal RST1 is at L level, the maximum value 
register 272 stores the maximum value of high-fre- 
quency components of Y signal with respect to the 
respective pixels in one horizontal line of any one of the 
parallax calculation regions El -El 2 that corresponds to 



the hortzontalA/erticai position of the input image signal. 
P)099] The gate 273 provides an output of the maxi- 
mum value register 272 in response to the region 
boundary signal RST1 rising to H level while providing 

5 an output of 0 when tiie region boundary signal RST1 is 
at L level. That is. each time the region boundary signal 
RST1 rises to H level, the gate drcuit 273 outputs the 
maximum value of the high-frequency components of Y 
signal with respect to one horizontal line of a given par- 

10 allax calculation region El -El 2, the maximum value 
stored in the maximum value register 272. Hence, inte- 
gration values of maximum values of high-frequency 
components of Y signal with respect to the respective 
horizontal lines of the respective parallax calculation 

15 regions are stored In the corresponding high-frequency 
integration registers 241 -252 (see Fig.7). 
[01 00] Fig. 1 0 diagrammatically illustrates a configura- 
tion of the luminance contrast calculating drcuit 9. 
[0101] The luminance contrast calculating circuit 9 

20 includes a timing signal generating circuit 301 and a 
luminance contrast sensing circuit group 302. The lumi- 
nance contrast sensing drcuit group 302 indudes first 
to twelfth luminance contrast sensing drcuits 311-322 
corresponding to the parallax calculation regions E1- 

25 E12, respectively 

[0102] The timing signal generating circuit 301 pro- 
vides the same input and output signals as those of the 
timing signal generating circuit 201 shown in Fig.3. 
[0103] As shown in Fig.11, the lunrunance contrast 

30 sensing circuits 311-322 each include a first compari- 
son circuit 331, a maximum value register 332. a sec- 
ond comparison circuit 333. a minimum value register 
334 and a sut^tractor 335. 

[0104] The maximum value register 332 is supplied 

35 with Y signal of the input image signal, any one of the 
enable signals EN (Nsl .2...12) of any one of the regions 
El -E1 2 corresponding to any one of the luminance con- 
trast sensing drcuits, a reset signal RST, a judgment 
signal L±> outputted from the first comparison circuit 331 

40 and a clock signal CLK. The first comparison circuit 331 
compares the output value of the maximum value regis- 
ter 332 with Y signal of the input inr^ge signal so as to 
raise the judgment signal Lb to H level when determin- 
ing Y signal of the input image signal to be greater than 

45 the output value from the maximum value register 332. 
[0105] Raised to H level, the reset signal RSt resets 
a content of the maximum value register 332 to 0. When 
the enable signal EN of any one of the regions El -El 2 
corresponding to the luminance contrast sensing circuit 

50 and the judgment signal Lb are botii at H level, Y signal 
is stored in the maximum value register 332. That is, the 
content of the maximum value register 332 is updated. 
Accordingly immediately before tiie output timing signal 
DOUT is outputted, the maximum value of luminance 

55 values of the respective pixels in any one of the parallax 
calculation regions E1-E12 conresponding to the lumi- 
nance contrast sensing drcuit is stored In the maximum 
value register 332. 
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[0106] The minimum value register 334 is supplied 
with Y signal of the input image signal, an enable signal 
EN {N=1,2 ..,12) of any one of the regions E1-E12 cor- 
responding to any one of luminance contrast sensing 
drcuits. the reset signal RST, a judgment signal Lc out- 5 
putted from the second comparison circuit 333 and the 
dock signal CLK. The second comparison circuit 333 
compares the output value from the minimum value reg- 
ister 334 with Y signal of the input image signal so as to 
raise the judgment signal Lc to H level when determin- w 
ing Y signal of the input image signal to be smaller than 
the output value from the minimum value register 334. 
[01O7] When the reset signal RST rises to H level, a 
predetermined maximum value is set in the minimum 
value register 334. When the enable signal EN of any is 
one of the regions E1-E12 corresponding to the lumi- 
nance contrast sensing circuit and the judgment signal 
Lc are both at H levels Y signal is stored in the minimum 
value register 334. That is, the content of the minimum 
value register 334 is updated. Accordingly, immediately 20 
before the output timing signal DOUT is oulputted. the 
minimum value of luminance values of the pixels in any 
one of the parallax calculation regions E1-E12 corre- 
sponding to the luminance contrast sensing circuit is 
stored in the minimum value register 334. 2S 
[0108] As a result, at the time of output of the output 
timing signal DOUT, an output from the subtracter 335 
has a value equal to a difference (luminance contrast) 
between the maximum value and the. minimum value of 
the luminance values of the pixels in any one of the par- 30 
allax calculation regions El -El 2 corresponding to the 
luminance contrast sensing circuit. In response to the 
output timing signal DOUT, the subtracter 335 applies 
the output (luminance contrast) to the CPU 3. 
[01O9] Fig. 12 diagrammaticaily illustrates a corrfigura- 3S 
tion of the chroma integrating circuit 10. 
[0110] The chroma integrating circuit 10 includes a 
timing signal generating circuit 341 . a chroma calculat- 
ing circuit 342. an adder circuit 343, a chroma integra- 
tion register group 344 and a selector drcuit 345. The 40 
chroma integration register group 344 includes first to 
twelfth chroma Integration registers 351-362 corre- 
sponding to the parallax calculation regions E1-E12. 
respectively. 

[0111] The timing signal generating circuit 341 pro- 4S 
vides the same input and output signals as those of the 
timing signal generating circuit 201 shown in Fig.3. 
[0112] The chroma calculating circuit 342 arithmeti- 
cally finds a value SA1 with respect to a chroma by 
using the following equation (3) : so 

SA1 =:(R-Y)^ +(B-Y)^ (3) 

wherein (R-Y) denotes a value of (R-Y) signal of the 
input image signal and (B-Y) denotes a value of (B-Y) ss 
signal of the input image signal. 
[0113] The reset signal RST is outputted as timed to 
the start of the valid image of tiie input image signal for 



resetting contents of the respective chroma integration 
registers 351-362 to 0. Where the horizontal/vertical 
position of the input Image signal is in the first parallax 
calculation region E1» the first enable signal EN1 rises 
to H level, so tiiat a chroma retained by the first chroma 
integration register 351 is supplied to the adder circuit 
343 via the selection circuit 345 while the chroma deter- 
mined by the chroma calculating circuit 342 is applied to 
the adder circuit 343. 

[01 14] Thus, tfie chroma retained by the first chroma 
integration register 351 and the chroma given by ttie 
chroma calculating circuit 342 are added togettier by 
the adder circuit 343. A resultant sum is stored in tiie 
first chronna integration register 351 . That is, when the 
horlzontalA/ertical position of the input image signal is in 
the first parallax calculation region E1, chromas of tiie 
pixels in the first parallax calculation region El are 
sequentially integrated while the integration results are 
accordingly stored in tiie first chroma integration regis- 
ter 351. 

[01 1 5] In this manner, the chroma integration values 
of the respective parallax calculation regions E1-E12 
are stored in the corresponding chroma integration reg- 
isters 351-362. When the output timing signal DOUT 
rises to H level, the chroma integration values stored in 
the respective chroma integration registers 351 -362 in 
correspondence to the parallax calculation regions E1- 
E12 are supplied to the CPU 3 via a data bus. 
[01 1 6] Fig. 1 3 diagrammaticaily illustrates a method of 
calculating a parallax value taken by the GPU 3. 
[0117] Rrst normalizing means 401 servesto normal- 
ize a high-frequency component Integration value per 
parallax calculation region E1-E12 in a range of 
between 0 and 10. Second normalizing means 402 
serves to normalize a luminance contrast per parallax 
calculation region El -El 2 in a range of between 0 and 
10. Third normalizing means 403 serves to normalize a 
luminance integration value per parallax calculation 
region E1-E12 in a range of between 0 and 10. Fourth 
normalizing means 404 serves to normalize a chroma 
integration value per parallax calculation region El -El 2 
in a range of between 0 and 10. 
[0118] The high-frequency component integration 
value per parallax calculation region E1-E12 thus nor- 
malized is multiplied by a factor K1 by multiplying means 
405 and subsequentiy, the product is applied to adding 
means 409. The normalized luminance contrast per 
parallax calculation region El -El 2 is multiplied by a fac- 
tor K2 by multiplying means 406 and subsequently, the 
product is applied to tiie adding means 409. The nor- 
malized luminance Integration value per parallax calcu- 
lation region El -El 2 is multiplied by a factor K3 by 
multiplying means 407 and subsequentiy, the product is 
applied to the adding means 409. The normalized 
chroma integration value per parallax calculation region 
El -E1 2 is multiplied by a factor K4 by multiplying means 
408 and subsequentiy, tiie product is applied to the add- 
ing means 409. 
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[01 1 9J Specific exampiGS of the factors K1 to K4 are 
K1=0.6. K2=0.2, K3=0.1, K4=0.1, or K1=0.75, i^=0.25, 
K3=0.0. K4=0.0. 

[01201 The set values of these factors K1 to K4 are 
controlled whereby an optional one selected fronn the s 
group consisting of the high-frequency conponent inte- 
gration value, the luminance contrast, the luminance 
integration value and the chroma integration value or an 
optional combination thereof may be used as the per- 
spective image characteristic valua io 
[01 21 J That is, the high-frequency component integra- 
tion value alone may be used as the perspective image 
characteristic value. The luminance contrast alone nnay 
be used as the perspecth/e image characteristic value. 
Alternatively, a combination of the high-frequency com- is 
ponent integration value and luminance contrast may be 
used as the perspective image characteristic value. Fur- 
ther, a combination of the high-frequency component 
integration value, luminance contrast and luminance 
integration value may be used as the perspective image 20 
characteristic value. A combination of the high-fre- 
quency component integration value, luminance con- 
trast and chroma integration value may be used as the 
perspective image characteristic value. An alternative 
combination of the high-frequency component Integra- 2S 
tion value, luminance contrast, luminance integration 
value and chroma integration value may be used as the 
perspective image characteristic value. 
[0122] The adding means 409 serves to add up the 
respective values of each parallax calculation region 30 
E1-E12 given by multiplying means 405 to 408. A sum 
per parallax calculation region E1-E12 given by the add- 
ing means 409 is normalized by fifth normalizing means 
410 in a range of between 0 and 1 0 (hereinafter referred 
to as "depth information"). Fig. 14 shows a relation 3S 
between the output value from the adding means 409 
and the depth information given by the fifth normalizing 
means 410. The depth information per parallax calcula- 
tion region E1-E12 is meant to define the perspective 
image information per parallax calculation region El- 40 
El 2. The depth information per parallax calculation 
region E1 -El 2 given by the fifth normalizing means 410 
is supplied to a depth conrecting means 41 1 . 
[0123] In typical images, a subject is located to the 
front while a background is located to the rear. In most 45 
cases, the focus is on the subject. Therefore, it is 
believed that the nrrore to the front is an object, the 
greater are the high-frequency component, contrast, 
luminance and chroma. Hence. It is assumed in the 
embodiment hereof that a region with a greater high-f re- so 
quency component integration value, luminance con- 
trast, luminance integration value and chroma 
integration value represents an object located corre- 
spondingly more to the front. 

[01 24] Accordingly, it may be determined that a region 55 
with the greater depth information piece given by the 
adding means 409 represents an object located the 
more to the front. If a perspective position of the region 



representing the object located most to the front is set 
on a screen position of the 3D display unit, the depth 
information given by the adding means 409 and a depth 
value from the screen position are indirectly propor- 
tional. 

[0125] Now, description will hereinbelow be made on 
a depth correction processing performed by the depth 
correcting means 41 1 . 

[0126] The description of the depth correction 
processing is more easily understood if it is made by 
way of example of the parallax calculation regions actu- 
ally defined. Accordingly, the deptii correction process- 
ing performed by the depth correcting means 41 1 will be 
described by way of example of 60 parallax calculation 
regions actually defined with respect to one image field. 
Fig.15 shows 60 parallax calculation regions F1-F60 
actually defined in the one field. 
[0127] First, there is calculated a mean value of deptii 
information on tiie parallax calculation regions F1-F60 
on a row-by-row basis. Where the parallax calculation 
regions F1 -F60 have respective deptii information 
pieces of values as shown in Rg.16, mean values of 
depth information on first to sixth rows of the regions are 
1.2, 3.6, 6.0. 7.2, 4.0 and 1.2. 

[0128] Subsequently, of the rows of parallax calcula- 
tion regions, extracted is a region row wherein fore- 
ground object(s) occupy a greater area than in any other 
region rows. That is, the region row having the greatest 
mean value of the depth information is extracted. 
According to the example of Fig.16. the forth row of 
regions is extracted. 

[0129] Subsequently, regions of rows lower than the 
extracted row are each adjusted in the depth informa- 
tion piece thereof so that the depth information piece on 
each region is not sharply decreased from that of a 
region right thereabove. More specifically, each region 
of the rows lower than the extracted row. that has a 
depth information piece smaller than a region right 
tiiereabove by not less tiian 3, is changed in the depth 
information piece thereof to a value smaller than tiiat of 
the region thereabove by 2. 

[01 30] In the example of Fig.1 6, out of the regions F41 
to F50 of the fifth row, the regions F42 to F49 having the 
depth information smaller than the respective regions 
thereabove by not less than 3 are first corrected in their 
depth information, as shown in Fig.1 7. Subsequentiy, of 
the regions F51 to F60 of the sixth row. the regions F53 
to F58 having the depth information pieces smaller than 
those (corrected information pieces) of the respective 
regions thereabove by not less than 3 are corrected in 
tiie depth information pieces thereof. 
[0131] Where depth information has such a relation 
with a vertical screen position at an optional horizontal 
position as r^resented by a curve U1 in Rg.25. the 
relation of the depth information versus the vertical level 
screen position is corrected to that represented by a 
curve U2 in Fig.25. 

[01 32] It is for the following reason tiiat, of the rows of 
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parallax calculation regions, the regions of the rows 
below the region row wherein the foreground object(s) 
occupy a greater area than in these rows are corrected 
in the depth information thereof. 
[0133] In most cases, objects on the front of the scene 
are located on the lower side of the screen. In addition, 
images of the objects located on the lower side of the 
screen, such as of ground and the like, often have little 
variation. The image with little variation like that of the 
ground has a low high-frequency component and there- 
fore, has a low depth information value despite being 
located to the front. Hence, the depth correction is pro- 
vided in order to increase the depth Information value 
with respect to the image of the foreground object and 
with a low high-frequency component to a degree that 
the depth information value of such a region is not 
excessive of that of a region thereabove. 
[01 34] The depth information on the respective paral- 
lax calculation regions (actually F1 to F60 but assumed 
to be El to El 2 for easy reference purposes) thus cor- 
rected by the depth conrecting means 41 1 is normalized 
by renormalizing means 412 in a range of between 0 
and 10. The depth information per region E1-E12 given 
by the renormalizing means 412 is converted into paral- 
lax information per region E1-E12 by parallax Informa- 
tion decision means 413. 

[0135] The parallax information dedsion means 413 
converts the depth information per region El -El 2 into 
the parallax information per region based on a predeter- 
mined relation between the depth information and the 
parallax Information. The relation of the depth informa- 
tion versus the parallax information is indirectly propor- 
tional as represerned by a straight line SI or S2 shown 
in Fig. 19. 

[0136] Referring to Fig. 19. the relation of the depth 
information versus the parallax information represented 
by the straight line Si is used for obtaining a 3D image 
featuring a relatively great stereoscopic effect. On the 
other hand, the relation of the depth information versus 
the parallax information represented by the straight line 
S2 is used for obtaining a 3D image featuring a rela- 
tively small stereoscopic effect The stereoscopic effect 
of tiie 3D image can be adjusted by controlling the rela- 
tion of the parallax information versus the depth infor- 
mation in a range of between the straight lines SI and 
S2. 

[0137] The parallax information per parallax calcula- 
tion region E1-E12 thus obtained is supplied to the par- 
allax control circuit 4 (see Fig.1). It is to be noted that 
the depth correction performed by the deptii correcting 
means 41 1 may be omitted. 

[0138] Fig.20 diagrammatically illustrates essential 
configurations of the parallax control circuit and the 
optional pixel delays FIFOs shown in Fig.1. 
[0139] Out of the optional pixel delays FIFOs 1 1 to 1 3 
and 21 to 23, only the I eft- eye-image optional pixel 
delay FIFO 11 and the rIght-eye-image optional pixel 
delay FIFO 21 related to Y signal are shown in Fig.20. 



However, the other optional pixel delays FIFOs 12-13 
and 22-23 have the same corrfiguration and are subject 
to the same control and therefore, a description tiiereof 
is omitted. 

5 [0140] It is to be noted that the parallax information 
calculated by tfie CPU 3 pertains a central position of 
tiie respective parallax calculation regions E1-E12. The 
parallax control circuit 4 serves to obtain parallax infor- 
mation with respect to the respective pixel positions in 
10 the one-field screen based on the parallax information 
with respect to the central position of the respective par- 
allax calculation regions El -El 2. The read addresses of 
the left-eye-image optional pixel delays FIFOs 11-13 
and of the right-eye-image optional pixel delays FIFOs 
IS 21-23 are controlled based on the parallax information 
per pixel position in order to produce, from the 2D image 
signal in each pixel position, a left eye image and a right 
eye image which have parallax therebetween based on 
the parallax information with respect to the pixel posi- 
tion. 

[01 41 ] The parallax information on the respective pixel 
positions in the one-field screen is generated by means 
of a timing signal generating circuit 51, a parallax inter- 
polation factor generating circuit 52. parallax informa- 
tion storage means 60. a parallax selection circuit 80, 
first to fourth multipliers 81-84 and an adder circuit 85. 
[0142] The horizontal synchronizing signal Hsync and 
the vertical synchronizing signal Vsync of the input 
image signal are applied to the timing signal generating 
circuit 51 . In addition, the dock signal CLK for detecting 
the horizontal address of each horizontal period is also 
applied to the timing signal generating circuit 51 . 
[0143] Based on the horizontal synchronizing signal 
Hsync, vertical synchronizing signal Vsync and clock 
signal CLK. the timing signal generating circuit 51 gen- 
erates and outputs a horizontal address signal HAD 
indicative of an absolute horizontal position of the input 
image signal, a vertical address signal VAD indicative of 
an absolute vertical position of the input image signal, a 
relative horizontal position signal HPOS indicative of a 
relative horizontal position of the Input Image signal and 
a relative vertical position signal VPOS indicative of a 
relath/e vertical position of the input image signal. 
[0144] Now, the relative horizontal position and the 
relative vertical position of the input image signal will be 
described. 

[0145] As shown in Fig.21, tiie parallax calculation 
regions El -El 2 of Fig.2 are defined In tiie following 
manner. A whole screen is divided into 20 regions 
(hereinafter referred to as "lirst segment region") 
arranged in 4 rows and 5 columns, as indicated by bro- 
ken lines in Fig.21. A rectangular area having four ver- 
texes positioned at respective centers of upper left, 
upper right. lower left and lower right first segment 
regions is divided into 1 2 regions (hereinafter referred to 
as "second segment region") arranged in 3 rows and 4 
columns. These 12 second segment regions are 
defined as the parallax calculatfon regions E1-E12, 
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respectively. 

[0146] In the figure, "m" denotes a number of horizon- 
tal pixels of the first or second segment region whereas 
"n" denotes a number of vertical pixels of the first or sec- 
ond segment region. The relative horizontal position of s 
the input image signal is denoted by any one of the 
numerals of not less than 0 to (m-l) with "0" indicating a 
left end position and "(m-l)" indicating a right end posi- 
tion of each first segment region. A relative vertical posi- 
tion of the Input image signal is denoted by any one of io 
the numerals of not less than 0 to (n-1) with "0" indicat- 
ing an upper end position and (n-1) indicating a lower 
end position of each first segment region. 
[0147] The relative horizontal position signal HPOS 
and the relative vertical position signal VPOS of the is 
input image signal are supplied to the parallax interpo- 
lation foctor generating circuit 52. Based on the relative 
horizontal position signal HPOS. relative vertical posi- 
tion signal VPOS and the following equations (4). the 
parallax interpolation factor generating circuit 52 gener- 20 
ates and outputs a first parallax interpolation factor 
KUL, a second parallax interpolation factor KUR, a third 
parallax interpolation factor KDL and a fourth parallax 
interpolation fector KDR: 

25 

KUL={(m-HOPS)/m} x{(n-VPOS)/n} (4) 

KUR=(HPOS/m) x{{N-VPOS)/n} 

KDL={(m-HPOS)/m)x(VPOS/n) 30 

KDR=(HPOS/m)x(VPOS/n) 

[0148] Now referring to Fig.22. description will be 
made on a basic concept of a method of generating the 35 
parallax information on each pixel position in the one- 
field screen. It is assumed that a horizontal/vertical 
position (hereinafter referred to as "target position") 
indicated by the horizontal address signal HAD and the 
vertical address signal VAD is at Pxy in Fig.22. How to 4o 
obtain parallax information on the target position Pxy 
will be described as below. 

(1) First, out of the parallax information on the 
respective parallax calculation regions El -E12 cal- 45 
culated by the CPU 3, parallax information pieces 
on the parallax calculation regions El. E2. E5 and 
E6 are first extracted as UL, UR. DL and DR. 
respectively, in this example. The regions El , E2, 
E5 and E6 include four vertexes PE1» PE2. PES, so 
PES of a first segment region witii the target posi- 
tion Pxy at their respective centers. More specifi- 
cally, the parallax information piece on the region 
E1 » wherein the upper left vertex of the first seg- 
ment region with the target position Pxy is located ss 
at the center thereof, is extracted as a first parallax 
information UL. the parallax information piece on 
the region E2 with the upper right vertex of the first 



segment region located at its center being 
extracted as a second parallax information UR, the 
parallax information piece on the region E5 with the 
lower left vertex of tiie first segment region located 
at its center as a third parallax information DL and 
the parallax information piece on the region E6 witii 
the lower right vertex of the first segment region 
located at its center as a fourth parallax information 
DR. 

It is to be noted that in a case where only one 
of the four vertexes of a first segment region with 
the target position is at the center of a parallax cal- 
culation region like when the first segment region is 
at the upper left corner of the screen, a parallax 
information piece on this parallax calculation region 
is extracted as the first to the fourth paralleix infor- 
mation pieces UL. UR. DL. DR. 

In a case where only tower two of the four ver- 
texes of a first segment region with the target posi- 
tion are located at the respective centers of parallax 
calculation regions like when the first segment 
region with the target pixel adjoins an upper-left- 
corner first segment region on its right side, paral- 
lax information pieces on parallax calculation 
regions conrespondlng to the lower two vertexes of 
the first segment region are extracted also as paral- 
lax information pieces UL and UR on parallax cal- 
culation regions corresponding to the upper two 
vertexes thereof. 

In a case where only right-hand two of the four 
vertexes of a first segment region with the target 
position are located at the respective centers of 
parallax calculation regions like when the first seg- 
ment region with the target pixel is immediately 
under the upper-left-corner first segment region, 
parallax information pieces on the parallax calcula- 
tion regions corresponding to the right-hand two 
vertexes of the first segment region are extiracted 
also as parallax information pieces UL, DL on par- 
allax calculation regions corresponding to the left- 
hand two vertexes thereof. 

In a case where only upper two of the four ver- 
texes of a first segment region with the target posi- 
tion are located at the respective centers of parallcix 
calculation regions like when the first segment 
region with the target pixel adjoins a lower-right- 
corner first segment region on its left side, parallax 
information pieces on the parallax calculation 
regions corresponding to the i^^per two vertexes of 
the first segment region are extracted also as paral- 
lax information pieces DL. DR on parallax calcula- 
tion regions conrespondlng to the lower two 
vertexes thereof. 

In a case where only left-hand two of the four 
vertexes of a first segment region with the target 
position are located at the respective centers of 
parallax calculation regions like when tiie first seg- 
ment region with tiie target pixel is located Immedi- 
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ately above the lower-right-corner first segment 
region, parallax information pieces on the paraHax 
calculation regions corresponding to the left-hand 
two vertexes of the first segment region are 
extracted also as parallax information pieces UR, $ 
DR on parallax calciiation regions corresponding 
to the right-hand two vertexes thereof. 
(2) Subsequently, the first to fourth parallax interpo- 
lation Actors KUL. KUR, KDL and KDR are deter- 
mined. 10 

The first parallax interpolation factor KUL is 
given by a product of a ratio {(m-HPOS)/m} of a dis- 
tance AXR between the target position Pxy and a 
right side of a first segment region e with the target 
position Pxy versus a horizontal length m of the first is 
segment region e, and a ratio {(n-VPOS)/n} of a dis- 
tance AYD between the target position Pxy and a 
lower side of the first segment region e versus a 
vertical length n of the first segment region e. That 
is. the first parallax interpolation factor KUL corre- 20 
spondingly increases as a distance between an 
upper left vertex PE1 of the first segment region e 
with the target position Pxy and the target position 
Pxy decreases. 

The second parallax interpolation factor KUR is 2s 
given by a product of a ratio (HPOS/rn) of a dis- 
tance AXL between tiie target position Pxy and a 
left side of the first segment region e with the target 
position Pxy versus the horizontal length m of the 
first segment region e, and a ratio {(n-VPOS)/n} of a 30 
distance AYD between the target position Pxy and 
the lower side of the first segment region e versus 
the vertical length n of the first segment region e. 
That is. the second parallax interpolation factor 
KUR correspondingly increases as a distance 35 
between an upper right vertex PE2 of the first seg- 
ment region e with the target position Pxy and the 
target position Pxy decreases. 

The third parallax interpolation factor KDL is 
given by a product of a ratio ((m-HPOS)/m} of a dis- 40 
tance AXR between the target position Pxy and the 
right side of the first segment region e with the tar- 
get position Pxy versus the horizontal length m of 
the first segment region e, and a ratio (VPOS/n) of 
a distance AYU between the target position Pxy and 45 
an upper side of the first segment region e versus 
the vertical length n of the first segment region e. 
That is. the third parallax interpolation factor KDL 
con-espondingly increases as a distance between a 
lower left vertex PES of the first segment region e so 
with the target position Pxy and the target position 
Pxy decreases. 

The fourth parallax interpolation factor KDR is 
given by a product of a ratio (HPOS/m) of a dis- 
tance AXL between the target position Pxy and the 55 
left side of the first segment region e with the target 
position Pxy versus the horizontal lengtii m of the 
first segment region e. and a ratio (VPOS/n) of a 



distance AYU between the target position Pxy and 
the upper side of the first segment region e versus 
tiie vertical length n of the first segment region e. 
That is, the fourth parallax interpolation factor KDR 
correspondingly increases as a distance between a 
lower right vertex PE6 of the first segment region e 
with the target position Pxy and the target position 
Pxy decreases. 

(3) The first to the fourth parallax information pieces 
UU UR. DL. DR extracted in tiie aforesaid step (1) 
are respectively multiplied by the first to the fourth 
parallax Interpolation factors KUL. KUR. KDL. KDR 
given in the aforesaid step (2). Then, parallax infor- 
mation on the target position Pxy is generated by 
summing up the resultant four products. 

[0149] The parallax information storage means 60 
includes first to twelfth parallax registers 61 -72 in corre- 
sponding relation with the regions E1-E2, respectively. 
The first to twelfth parallax registers 61-72 respectively 
store the parallax information pieces on the regions E1- 
E12 generated by the CPU 3. 

[0150] The parallax selection circuit 80 is provided 
rearwardly of the parallax information storage means 
60. The parallax selection circuit 80 is supplied with the 
parallax information by the parallax registers 61-72 , 
respectively. Furthermore, the parallax selection circuit 
80 is also supplied with the horizontal address signal 
HAD and the vertical address signal VAD by the timing 
signal generating circuit 51. 

[0151] According to a rule shown in Rg.23a, the par- 
allax selection circuit 80 selectively outputs parallax 
information on a region con^esponding to a horizontal 
address signal HAD and a vertical address signal VAD 
(in tiie example shown in Fig.22. the parallax calculation 
region wherein tiie upper left vertex of the first segment 
region with the target position is located at the center 
thereof) as the first parallax information UL, Further 
according to a rule shown in Fig.23b. the parallax selec- 
tion circuit 80 selectively outputs parallax information on 
a region corresponding to a horizontal address signal 
HAD and a vertical address signal VAD Cm the example 
of Fig.22» the parallax calculation region wherein the 
upper right vertex of the first segment region with the 
target position is located at the center thereof) as the 
second parallax information UR. 
[0152] According to a rule shown in Fig.23c, tiie par- 
allax selection circuit 80 selectively outputs parallax 
information on a region corresponding to a horizontal 
address signal HAD and a vertical address signal VAD 
(in the example of Fig.22, the parallax calculation region 
wherein tiie lower left vertex of the first segment region 
with the target position is located at the center thereof) 
as the third parallax information DL. Further according 
to a rule shown in Fig.23d. the parallax selection circuit 
80 selectively outputs parallax infornrtation on a region 
corresponding to a horizontal address signal HAD and a 
vertical address signal VAD (in tiie example of Fig.22, 
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the parallax calculation region wherein the lower right 
vertex of the first segment with the target position Is 
located at the center thereof) as the fourth parallax 
information DR. In Rg.23, a representation •*a-b" like 
''O-m" denotes a value of not less than "a" and less than s 

[0153] The first parallax information UU the second 
parallax information UR. the third parallax information 
DL and the fourth parallax information DR. which are 
selected by the parallax selection drcuit 80, are applied io 
to the first to the fourth multipliers 81-84. respectively. 
[01541 The first to the fourth multipliers 81-84 also 
receives from the parallax irrterpolation factor generat- 
ing circuit 52 the first parallax Interpolation ^ctor KUL. 
the second parallax interpolation fector KUR. the third is 
parallax interpolation factor KDL and the fourth parallax 
interpolation factor KDR. respectively 
[0155] The first multiplier 81 multiplies the first paral- 
lax information UL by the first parallax interpolation fac- 
tor KUL The second multiplier 82 multiplies the second 20 
parallax information UR by the second parallax Interpo- 
lation factor KUR. The third multiplier 83 multiplies the 
third parallax information DL by the third parallax inter- 
polation factor KDL. The fourth multiplier 84 multiplies 
the fourth parallax information DR by the fourtii parallax 25 
interpolation factor KDR. 

[0156] Outputs of these multipliers 81-84 are added 
together by the adder circuit 85 for generating parallax 
information PR on the target position. 
[0157] The optional pixel delays FIFOs 11 and 21 30 
each include a pair of line memories 1 la-lib or 21a- 
21b for performing horizontal phase control on a basis 
smaller than one pixel. The respective pairs of line 
memories 1 la-lib and 21a-21b of the optional pixel 
delays FIFOs 11.21 are si^^plied with Y signal and the 3S 
clotik signal GLK. 

[0158] The horizontal address signal HAD outputted 
from tiie timing signal generating circuit 51 is also 
applied to a standard address generating circuit 90. The 
standard address generating circuit 90 generates and 40 
outputs a starxiard write address WAD and a standard 
read address RAD for each of the line memories 1 la- 
lib and 21 a-21b of the optional pixel delays FIFOs 1 1 
and 21 . Further, the standard address generating circuit 
90 also outputs a synchronizing signal Csync added to 45 
the left-eye image signal and the right-eye image signal 
which are generated by the 2D/3D converter. A horizon- 
tal synchronizing signal represented by the synchroniz- 
ing signal Csync is delayed relative to the horizontal 
synchronizing signal Hsync of the input image signal by so 
a predetermined number of clocks. 
[01 59] The standard read address RAD Is delayed rel- 
ative to the standard write address WAD by a predeter- 
mined number of clocks so that the horizontal phase of 
the image signal inputted in the resp>ective optional pixel ss 
delays FIFOs 11, 21 may lead or lag relative to a refer- 
ence horizontal phase defined by the standard read 
address. The standard write address WAD outputted 



from the standard address generating circuit 90 Is 
applied to the respective pairs of line memories 1 1a-1 lb 
and 21a-21b of the optional pixel delays FIFOs 11. 21 
as a write control signal indicative of an address to write 
to. 

[0160] The standard read address RAD outputted 
from the standard address generating circuit 90 is 
applied to an adder 91 and a subtracter 92. The adder 
91 and tiie subtracter 92 are also supplied with the par- 
allax information PR on the target position which is sup- 
plied from the adder circuit 85. 
[01 61 ] The adder 91 serves to add the parallax Infor- 
mation PR to the standard read address RAD, thereby 
giving a left-eye image read address PRL 
[0162] An integer portion PRL1 of the left-eye image . 
read address PRL is applied, as a read address RADL1 , 
to the first line memory 11a of the left-eye image 
optional pixel delay FIFO 1 1 . This permits Y signal to be 
read out from an address of tiie first line memory 11a in 
correspondence to the address RADL1 . The Y signal 
thus read out Is applied to a first left- eye image multiplier 
101. 

[01 63] An address value given by adding 1 to the inte- 
ger portion PRL1 of the left-eye image read address 
PRL is applied as a read address RADL2 to the second 
line memory lib of the left-eye image optional pixel 
delay FIFO 1 1 . This permits Y signal to be read out from 
an address of the second line memory lib in corre- 
spondence to the address RADL2, The Y agnat thus 
read out is applied to a second left-eye image multiplier 
102. 

[01 64] The read address RADL1 for the first line mem- 
ory 11a differs from the read address RADL2 for the 
second line memory 1 lb by "1" and therefore, the Y sig- 
nal read out from the first line memory 11a has a hori- 
zontal position shifted by "1" from that of tiie Y signal 
read out from the second line memory lib. 
[01 65] A decimal fraction portion PRL2 of the left-eye 
Image read address PRL is applied, as a second left- 
eye image interpolation factor, to the second left-eye 
image multiplier 102. A value (1-PRL2). which is 
obtained by subtracting the decimal fraction portion 
PRL2 of the left-eye image read address PRL from 1 . is 
applied to the first left-eye image multiplier 101 . as a first 
left-eye image interpolation factor. 
[0166] ThuSp the first left-eye image multiplier 101 mul- 
tiplies the Y signal read out from the first line memory 
11a by the first left-eye image interpolation factor (1- 
PRL2). The second left-eye image multiplier 102 multi- 
plies the Y signal read out from the second line memory 
lib by the second left-eye image interpolation factor 
PRL2. The resultant Y signals thus given by ttiese mul- 
tipliers 101. 102 are added together by an adder 103 
and then outputted as a left-eye image Y signal YL- 
OUT. 

[01 67] Thus is obtained the left-eye image Y signal, a 
horizontal phase value of which lags relative to the ref- 
erence horizontal phase defined by the starKlard read 
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address RAD by a value based on the parallax informa- 
tion on the target position. 

[0168] The subtractor 92 serves to subtract the paral- 
lax information PR from the standard read address 
RAD. thereby giving a right-eye image read address s 
PRR. 

[0169] An integer portion PRR1 of the right-eye image 
read address PRR is applied, as a read address 
RADR1. to the first line memory 21a of the right-eye 
image optional pixel delay FIFO 21 . This permits Y sig- io 
nal to be read out from an address of the first line mem- 
ory 21a in correspondence to the address i^DRI . The 
Y signal thus read out is applied to a first right-eye 
image multiplier 111. 

[01 70] An address value, which is given by adding 1 is 
to the integer portion PRR1 of the right-eye image read 
address PRB, is applied, as a read address RADR2, to 
the second line memory 21b of the right-eye image 
optional pixel delay FIFO 21 . This permits Y signal to be 
read out from an address of the second line memory 20 
21b in correspondence to the address RADR2. The Y 
signal thus read out is applied to a second right-eye 
image multiplier 112. 

[0171] The read address RADR1 for the first line 
memory 21a differs from the read address RADR2 for 25 
the second tine memory 21b by 1 and therefore, the Y 
signal read out from the first line memory 21a has a hor- 
izontal position shifted by 1 from that of the Y signal 
read out from the second line memory 21b. 
[0172] A dedmal fraction portion PRR2 of the right- 
^e image read address PRR is applied, as a second 
right-eye image interpolation factor, to the second right- 
eye image nnultiplier 112. A value (1-PRR2). which is 
obtained by subtracting the decimal fraction portion 
PRR2 of the right-eye image read address PRR from 1 , 35 
is applied to the first right-eye image multipner 1 1 1 , eis a 
first right-eye image interpolation factor. 
[0173] Thus, the first right-eye image multiplier 111 
serves to multiply the Y signal read out from the first line 
memory 21a by the first right-eye image interpolation 40 
factor (1-PRR2). The second right-^e image multiplier 
112 serves to multiply the Y signal read out from the 
second line memory 21b by the second right-eye image 
interpolation factor PRR2. The resultant Y signals thus 
given by these multipliers 111. 112 are added together 4s 
by an adder 113 and then outputted as a right-eye 
image Y signal YR-OUT. 

[0174] Thus is obtained the right-eye image Y signal, 
a horizontal phase value of which leads relative to the 
reference horizontal phase defined by the standard read so 
address RAD by a value based on the parallax informa- 
tion on the target position. 

[0175] Rg.24 is a timing chart showing signals in the 
respective parts when the parallax information on the 
target position is 0. ss 
[0176] Where the parallax information is 0, the left-eye 
image read address PRL outputted from the adder 91 
and the right-eye image read address PRR outputted 



from the subtractor 92 are both equal to the standard 
read address RAD. consisting only of the integer portion 
without the decimal fraction portion. 
[01 77] Therefore, the read address RADLI for the first 
line memory 11a of the left-eye image optional pixel 
delay FIFO 1 1 and the read address RADR1 for tiie first 
line memory 21a of the right-eye image optional pixel 
delay FIFO 21 are both equal to the standard read 
address RAD. 

[01 78] On the otiier hand, the read address R ADL2 for 
the second line memory lib of tiie left-eye image 
optional pixel delay FIFO 11 and the read address 
RADR2 for tiie second line memory 21b of the right-eye 
image optional p\XB\ delay FIFO 21 are both at a value 
greater tiian the standard read address RAD by 1 . 
[0179] The first left-eye image interpolation factor (1- 
PRL2) and the first right-eye image interpolation factor 
(1-PRR2) are both at a value of 1 whereas the second 
left-eye image interpolation ^ctor PRL2 and the second 
right-eye image irrterpolatbn factor PRR2 are both at a 
value of 0. 

[0180] As a result, the Y signal read out from the 
address of the first line memory 11a of the left-eye 
image optional pixel delay FIFO 11 in corresponderK;e 
to the standard address RAD is outputted from the 
adder 103 as the left-eye image Y signal YL-OUT, 
whereas the Y signal read out from the address of the 
first line memory 21a of the right-eye image optional 
pixel delay FIFO 21 in correspondence to the standard 
address RAD is outputted from tiie adder 113 as the 
right-eye image Y signal YR-OUT. That is. the two Y sig- 
nals having the same horizontal phase shift value or the 
two Y signals without parallax are outputted as the left- 
eye image Y signal and the right-eye image Y signal. 
[01 81 ] Fig.25 is a block diagram showing specific val- 
ues of the respective addresses in a case where the 
standard write address WAD for a certain target position 
is at 20, the standard read address for the target posi- 
tion is at 10 and the parallax information on the target 
position is 1.2. Rg.26 is a timing chart showing signals 
at the respective parts in this example. 
[0182] In tills case, a left-eye image read address PLR 
outputted from the adder 91 is at 11.2. the integer por- 
tion PRL1 of which is 11 and the decimal fraction por- 
tion PRL2 of which is 0.2. 

[0183] Accordingly, the read address RADLI for the 
first line memory 1 la of the left-eye image optional pixel 
delay FIFO 11 is at 11 whereas the read address 
RADL2 for the second line memory lib thereof is at 12. 
On the otiier hand, the first left-eye image interpolation 
factor KL1{«(1-PRL2)} is 0.8 whereas the second left- 
eye image interpolation factor KL2(s:PRL2) is 0.2. 
[0184] Thus, a Y signal (Y^i) is read out from the 
address 11 of the first line memory 11a of the left-eye 
image optional pixel delay FIFO 1 1 so that the first mul- 
tiplier 101 outputs a signal (O-SxY^^) gwen by multiply- 
ing the read Y signal (Y^ 1) by 0.8. 
[0185] On the otiier hand, a Y signal (Y12) is read out 
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from the address 12 of the second line memory 11b of 
the left-eye image optional pixel delay FIFO 1 1 so that 
the second multiplier 102 outputs a signal (0.2xYi2) 
given by multiplying the read Y signal (Y12) by 0.2. 
Then, the adder 103 outputs a left-eye image Y signal 
YL-OUT which is equal to 0.8xYii+0.2xYi2. In other 
words, the Y signal corresponding to the read address 
of 11.2 is outputted as the left-eye image Y signal YL- 
pUT. 

[0186] The subtracter 92 outputs a right-eye image 
read address PRR of 8.8, the integer portion of which is 
8 and the decimal fraction portion of which is 0.8. 
[0187] Accordingly, a read address RADR1 for thefirst 
line memory 21a of the right-eye image optional pixel 
delay FIFO 21 is at 8 whereas a read address RADR2 
for the second line memory 21b is at 9. On the other 
hand, the first right-eye image interpolation factor 
KR1{=(1-PPR2)} is 0.2 whereas the second right-eye 
image interpolation factor KR2(sPRR2) is 0.8. 
[0188] Thus, a Y signalCYs) is read out from the 
address 8 of the first line memory 21a of the right-eye 
image optional pixel delay FIFO 21 so that the first mul- 
tiplier 111 outputs a signal (0.2xY8) given by multiplying 
the read Y signal (Yg) by 0.2. 

[0189] On the other hand, a Y signal (Yg) is read out 
from the address 9 of the second line memory 21b of 
the right-eye image optional pixel delay FIFO 21 so that 
the second multiplier 112 outputs a signal (O.SxYg) 
given by multiplying the read Y signal CY9) by 0.8. Then, 
the adder 113 outputs a right-eye image Y signal YR- 
OUT equal to 0.2xY84O.8xY9. In other words, the Y sig- 
nal corresponding to the read address of 8.8 is output- 
ted as the right-eye image Y signal YR-OUT. 
[0190] As a result, there are obtained left-eye and 
right-eye images each having a parallax of 11.2- 
8.8=2.4, which is twice the paralleuc information piece of 
1.2. 

[0191] The 2D/3D image conversion apparatus 
according to the above embodiment eliminates the 
need for the field memories for generating the image 
signal timed delayed relative to the original 2D image 
signal and hence, accomplishes the cost reduction. 
Additionally, the 2D/3D image conversion apparatus of 
the above embodiment is adapted to produce the stere- 
oscopic image even from the original 2D image signal 
representing the still image. 

[Second Embodiment] 

[01 92] Now referring to Rgs.2. 1 5 and 27 to 42. a sec- 
ond embodiment of the invention will be described. 
[01 93] Rg.27 is a block diagram showing a whole con- 
struction of a 2D/3D image conversion apparatus for 
converting two-dimensional images into three-dimen- 
sional images. In the figure, like parts to those shown in 
Fig.1 are represented by Ht^ reference numerals, 
respectively. 

[0194] The luminance signal Y and color difference 



signals R-Y and B-Y, which compose the 2D image sig- 
nal, are respectively converted into the digital Y signal, 
R-Y signal and B-Y signal by the AD conversion circuit 
1 (ADC), 

5 [0195] Y signal is supplied to the luminance Integrat- 
ing circuit 7, the high-frequency component integrating 
circuit 8 and the luminance contrast calculating circuit 8 
as well as to the first left-eye-image optional pixel delay 
FIFO 11 and the first right-eye-image optional pixel 

10 delay FIFO 21 . R-Y signal is supplied to an R-Y compo- 
nent integrating circuit 31 as well as to the second left- 
eye-image optional pixel delay FIFO 12 and the second 
right-eye-image optional pixel delay FIFO 22. B-Y signal 
is supplied to a B-Y component integrating circuit 32 as 

IS well as to tiie third left-eye-image optional pixel delay 
FIFO 13 and the third right-eye-image optional pixel 
delay FIFO 23. 

[01 96] The high-frequency component integrating cir- 
cuit 8 has the same configuration with the circuit 8 of 

20 Fig.1, calculating a high-frequency component integra- 
tion value of each of the parallax calculation regions E1- 
E12 on a field-by-field basis, the parallax calculation 
regions El -E12 being previously defined in tiie one-field 
screen, as showvn in Fig.2. 

25 [0197] The luminance contrast calculating circuit 9 
has the same cortfigurati'on with the circuit 9 of Fig.1, 
calculating a luminance contrast of each of the parallax 
calculation regions El -E12 on a field-by-field basis. 
[0198] The R-Y component integrating circuit 31 cal- 

30 culates an integration value of R-Y component of each 
of the parallax calculation regions El -El 2 on afield-by- 
field basis. The B-Y component integrating circuit 32 
calculates an integration value of B-Y component of 
each of the parallax calculation regions El -El 2 on a 

35 field-by-field t>asis. The R-Y component integrating cir- 
> cult 31 and the B-Y component integrating circuit 32 are 
essentially configured the same way as the luminance 
irrtegrating circuit shown in Rg.3. More specifically, tiie 
R-Y component integrating drcuit 31 is established by 

40 inputting the R-Y component to a like circuit to the lumi- 
nance integrating circuit of Fig.3. Likewise, the B-Y 
component integrating circuit 32 \s established by input- 
ting the B-Y component to the like circuit to the lumi- 
nance irrtegrating circuit of Rg.3. 

45 [01 99] The high-frequency component integration val- 
ues, luminance contrasts. R-Y component integration 
values and B-Y component integration values of the 
respective parallax calculation regions E1-E12 are used 
as the perspective image characteristic values of the 

50 respective parallax calculation regions E1 -El 2. 

[0200] In actual practice, the one-fieki screen includes 
a total of 60 parallax calculation regions arranged in 6 
rows arKi 10 columns, as shown in Fig. 15. However, it is 
assumed for easy reference purposes tiiat a total of 12 

55 parallax calculation regions E1-E12 as arranged in 3 
rows and 4 columns are defined in tiie one-field screen, 
as shown in Rg.2. 

[0201] The CPU 3 generates parallax Information on 
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the respective parallax calculation regions El -El 2 
based on Information supplied from the high-frequency 
component integrating circuit 8, luminance contrast cal- 
culating circuit 9. R-Y component integrating circuit 31 
and B-Y component integrating circuit 32. In this exam- 5 
pie, the parallax information is generated such that a 
region representing an object located more to the front, 
like the subject of the scene, has correspondingly a 
smaller parallax value, while a region representing an 
object located more to the back, like the bacl^round of 10 
the scene, has correspondingly a greater parallax value. 
A method of generating the parallax information will 
hereinafter be described in detail. 
[0202] The parallax information per parallax calcula- 
tion region E1-E1 2 thus calculated by the CPU 3 is sent is 
to a parallax control circuit 4. The parallax corrtrol circuit 
4, in turn, generates parallax information per pixel posi- 
tion in each field based on the parallax information per 
parallax calculation region El -El 2. Based on the paral- 
lax information per pixel position, the parallax control 20 
circuit 4 controls the read addresses of FIFOs 11-13 
and 21 -23 to read the image signal (Y, R-Y and B-Y sig- 
nals) therefrom such that the read addresses of the left- 
eye-image optional pixel delays FIFOs 11-13 are shifted 
from the read addresses of the right-eye-image optional 25 
pixel delays FIFOs 21-23, respectively. Hence, the left- 
eye image signal read out from the left-eye-image 
optional pixel delays FIFOs 11-13 has a different hori- 
zontal phase from the right-eye image signal read out 
from the right-eye-image optional pixel delays FIFOs 30 
21-23 does. 

[0203] The left-eye Image signal (YL signal, (R-Y)L 
signal and (B-Y)L signal) read out from the left-eye- 
image optional pixel delays FIFOs 11-13 is converted 
into an analog signal by the DA conversion circuit (DAC) 35 
5 before supplied to an unillustrated 3D display unit. The 
right-eye image signal (YR signal. (R-Y)R signal and (B- 
Y)R signal) read out from the right-eye-inrtage optional 
pixel delays FIFOs 21-23 is converted into an analog 
signal by the DA conversion drcuit (DAG) 6 before sup- 40 
plied to the unillustrated 3D display unit. 
[0204] Since the left-eye image signal has a different 
horizontal phase from that of the right-eye image signal, 
a parallax is produced between the left eye image and 
the right eye image. As a result, by viewing the left eye 45 
image with the left eye alone and the right eye image 
with the right eye alone, a stereoscopic image Is estab- 
lished wherein the sid^ject is located to the front against 
the background, 

[0205] Fig.28 is a flow chart representing steps of a so 
parallax information generating procedure taken by the 
CPU 3 on a per-parallax-calculation-region basis. 
[0206] The parallax information generating procedure 
performed on each segment region includes: a grouping 
processing (Step 1); a spatial separation processing 55 
(Step 2); a singular point processing (Step 3); an inter- 
group coupling processing (Step 4); a per-group depth 
information generation processing (Step 5): an all- 



region depth Information correction processing (Step 6); 
a group-boundary depth information correction 
processing {Step 7); an in-group depth information cor- 
rection processing (Step 8); and a parallax information 
calculation processing (Step 9). 
[0207] Now the parallax information generating proce- 
dure will hereinbelow be described by way of example 
of 60 parallax calculation regions actually defined in one 
field. Rg.15 shows 60 parallax calculation regions F1- 
F60 actually defined in one field. 

(1) Grouping Processing 

[0208] The grouping processing of Step 1 Is an initial 
processing of the procedure which is Intended to divide 
all the regions constituting one image frame into groups 
associated with respective objects included in the 
image frame. There are two grouping methods which 
will be described as below. 

(1-1) Rrst Method 

[0209] First, high-frequency component integration 
values of the respective parallax calculation regions F1- 
F60 are normalized to values in a predetermined range 
(e.g.. 0 to 20). This is followed by the production of a ds- 
tribution (histogram) of parallax calculation regions (in 
number) belonging to the respective high-frequency 
component integration values thus normalized. Fig.29 
shows an example of the histogram thus produced. Par- 
allax calculation regions included in bars between val- 
leys in the histogram are combined into one group. The 
histogram may be based on the luminance contifast 
instead of the high-frequency component integration 
value. Fig.30 shows a result of dividing the parallax cal- 
culation regions F1-F60 into groups with symbols G1 to 
34 each indicating a group number. 

(1-2) Second Mettiod 

[021 0] First. R-Y component integration values of tiie 
respective parallax calculation regions F1-F60 are nor- 
malized to values In a range of between 0 and 20. This 
is followed by the production of distribution (histogram) 
of parallax calculation regions (in number) belonging to 
the respective normalized values of the R-Y component 
integration values. Based on the resultant histogram, 
intergroup t)oundary values are found from the nomnal- 
ized values of the R-Y component integration values. 
[021 1 ] On the other hand, the B-Y component integra- 
tion values of the respective parallax calculation regions 
F1-F60 are normalized to values in a range of between 
0 and 10. This is followed by the production of distribu- 
tion (histogram) of parallax calculation regions (in 
number) belonging to tiie respective normalized B-Y 
component integration values. Based on the resultant 
histogram, intergroup boundary values are found from 
the normalized B-Y component integration values. 
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[021 21 By using the two types of boundary values thus 
found, all the parallax calculation regions F1'F60 are 
divided into groups, as shouvn in Fig.31. Figs.32 and 33 
show results of dividing the parallax calculation regbns 
F1 -F60 irtto groups with symbols G1 to G5 each indicat- 5 
ing a group number. 

[021 3] In this example, the grouping processing is per- 
formed according to the second method. 

(2) Spatial Separation Processing 10 

[021 4] In the spatial separation processing of Step 2, 
out of the parallax calculation regions combined into the 
same group at Step 1 , parallax calculation regions spa- 
tially adjoining each other are considered to belong to is 
the same group. That is. although combined into the 
same group by the processing of Step 1. parallax calcu- 
lation regions spatially separated by another group are 
considered to belong to different groups. 
[0215] More specifically the parallax calculation 20 
regions determined to belong to the group 3 (G3) are 
divided into three groups 31 (G31), 32 (Q32) and 33 
(G33). as shown in Fig.34. 

(3) Singular Point Processing 25 

[021 6] In a case where a group consisting of a single 
parallax calculation region exists, the singular point 
processing determines virhether the single parallax cal-^ 
culation region corresponds to an object different from 30 
object(s) corresponded by neighboring groups or to the 
same object with that corresponded by any one of the 
neighboring groups. 

[0217] It is assumed, for example, that a group con- 
sists of a parallax calculation region A alone, as shown ss 
in Fig.35. In the figure, of the two parallax calculation 
regions located upwardly of the parallax calculation 
region A. the closer one to the region A is denoted by 
U1 and the other by U2. Of the two parallax calculation 
regions located downwardly of the region A, the closer 40 
one to the region A is denoted by D1 and the other by 
D2. Of the two parallax calculation regions located left- 
wardly of the region A, the closer one to the region A is 
denoted by LI and the other by D2. Of the two parallax 
calculation regions located rightwardly of the region A, 45 
the closer one to the region A is denoted by R1 and the 
other by R2. 

[021 8] In this case, when color distances between the 
region A and the adjoining regions U1, D1, L1 and R1 
are greater than those between the regions U1 , D1 . LI so 
and R1 and their adjoining regions U2, D2, L2 and R2. 
respectively, the group consisting of the region A alone 
is determined to constitute one independent group. Oth- 
erwise, the region A is determined to belong to any one 
of tiie neighboring groups. That is. the grouping of the ss 
regions is corrected. 

[021 9] Now, the definition of the color distance will be 
described. A color distance "dist" between a certain par- 
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ailax calculation region Fa and another parallax calcula- 
tion region Fb Is defined by tiie following equation (5): 

dist=|Fa(B-Y)-Fb(B-Y)|+|Fa{R-Y)-Fb(R-Y)| (5) 

wherein Fa(B-Y) and Fa{R-Y) denote a B-Y component 
Integratbn value and an R-Y component integration 
value of the parallax calculation region Fa, and Fb(B-Y) 
and Fb(R-Y) denote a B-Y component integration value 
and an R-Y component integrafa'on value of the parallax 
calculation region Fb. 

[0220] Assumed that, tor exanple. the region A shown 
in Fig.35 has (B-Y comporient integration value. R-Y 
component Integration value) of (-4, 5). the region U2 
has those of (-5, 4) and the region U2 has those of (-7. 
2). Then, a color distance "dist" between the regions A 
and U1 is "2" whereas a color distance 'cfisT between 
the regions U1 and U2 is "4". 

[0221] If the group 31 (G31) in Fig.34 consists of a sin- 
gle parallax calculation region and is determined to 
belong to the group 1 (G1) by the above singular point 
processing, the grouping of the regions is connected as 
shown in Rg.36. 

(4) Intergroup Coupling Processing 

[0222] In the intergroup coupling processing of Step 4. 
f irstiy calculated are mean values of the R-Y component 
integration values and of the B-Y conponent integration 
values of parallax calculation regions constituting each 
group. 

[0223] Subsequently, a color distance between adja- 
cent groups is calculated. Assumed that the two adjoin- 
ing groups are denoted by Ga and Gb. If the group Qa 
consists of n parallax calculation regions a1. a2....an. a 
mean value *Ga(B-Y) of the B-Y component integration 
values and a mean value *Ga(R-Y) of the R-Y compo- 
nent integration values of the group Ga are given by the 
following equations (6): 

*Ga(B-Y)={a1 (B-Y)+a2(B-Y)+...+an(B-Y)}+n (6) 

*Ga(R-Y)={a1(R-Y)+a2(R-Y)+...+an(R-Y)}^n 

[0224] Assumed that the group Gb consists of m par- 
allax calculation regions b1. b2, ...bm. a mean value 
*Gb(B-Y) of the B-Y component integration values and 
a mean value *Gb(R-Y) of the R-Y component integra- 
tion values of the group Gb are given by the following 
equations (7): 

*Gb(B-Y)={bl (B-Y)+b2(B-Y)+...+bm(B-Y)}-^m (7) 

*Qb(R-Y)=:{b1 (R-Y)+b2{R-Y)+...+bm(R-Y)}^m 

[0225] A odor distance "dist" between the groups Ga 
and Gb is defined by the following equation (8): 
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dist=|*Ga(B.Y)-*Gb(B-Y)|+|*Ga(R-Y)-*Gb{R-Y)| (8) 

[0226] Th en. whether the color distance between the 
adjacent groups is smaller than a threshold value or not 
is determined. If the color distance is smaller than the 5 
threshold value, these two groups are coupled together 
or combined into one group. 

(5) Per-Group Depth Information Generation Process- 
ing 10 

[0227] In the per-group depth information generation 
processing of Step 5, high-frequency component inte- 
gration values of the respective parallax calculation 
regions F1 -F60 are first normalized to values in a range is 
of between 0 and 10. Further, luminance contrasts of 
the respective parallax calculation regions F1-F60 are 
also normalized to values in the range of between 0 and 
10. 

[0228] The resultant normalized high-frequency com- 20 
ponent integration values arxl luminance contrasts as 
well as background weight components previously 
given to the respective parallax calculation regions F1- 
FBO are used to generate depth information on a group- 
by-group basts. 25 
[0229] Now, description will be made on a process of 
generating depth information on one optional group. 
Rrst, the number n of parallax calculation regions 
included in this group is found. On the other hand, a cal- 
culation is performed to find a sum total £a of normal- 3o 
fzed values **a" of high-frequency component integration 
values of the parallax calculation regions included in 
this group. A calculation is also performed to find a sum 
total lb of normalized values V of luminance cornrasts 
of the parallax regions of the group. Further, a calcula- 35 
tion is performed to f irxi a sum total Xc of weight compo- 
nents "c" of the parallax calculation regions of this 
group. 

[0230] Siidsequently, depth information H on the 
group is generated based on the following equation (9): 40 

H=(K1 • Ea+I^ • Zb4-K3 • rc)^n (9) 

wherein K1 , K2 and K3 denote factors defined as, for 
exanrple. K1 =3/8. K2=l/8. K3=4/8. 45 

(6) All-Region Deptii Information Correction Processing 

[0231] In the all-region depth information correction 
processing of Step 6, a mean value of depth information so 
on the parallax calculation regions FI-FGO is first deter- 
mined on a row-by-row basis. In a case where the depth 
information per parallax calculation region F1 -F60 is as 
shown in Fig. 38, for example, the first to the sixth region 
rows have a mean value of 1.2. 3.6. 6.0. 7.2. 4.0 and ss 
1.2, respectively. 

[0232] Of the rows of parallax calculation regions, 
extracted is a row of regions wherein foreground 



object(s) occupy a greater area than in the otiier region 
rows. That is, the region row having the greatest mean 
value of the depth information is extracted. According to 
the example of Fig.38. the regions of the fourth row are 
extracted. 

[0233] Subsequentiy. regions of rows below the 
extracted row are each adjusted in the depth informa- 
tion thereof so that each of the regions is not sharply 
decreased In the depth Information thereof relative to 
that of the region immediately thereabove. More specif- 
ically, of the regions included in the rows below the 
extracted row, a region, having depth information 
smaller than a region thereabove by not less than 3. is 
changed In its depth information to a value smaller than 
that of the region thereabove by 2. 
[0234] In the example of Fig.38. out of the regions 
F41 -F50 of the fifth row, the regions F42-F49 having tiie 
depth information smaller than the respective regions 
thereabove by not less than 3 are first corrected in their 
depth information, as shown in Fig.39. Subsequently, 
out of the regions F51-F60 of the sixth row. the regions 
F53-F58 tiaving the depth information smaller tiian 
those (after correction) of tiie respective regions therea- 
bove by not less than 3 are corrected in the depth Infor- 
mation thereof. 

[0235] Where depth information has such a relation 
with a vertical screen position at an optional horizontal 
position as represented by a curve U1 shown in Fig. 40, 
the relation of the depth information versus the vertical 
screen position is corrected to tiiat represented by a 
curve U2 shown in Rg.40. 

[0236] Out of the rows of parallax calculation regions, 
the region rows below the region row wherein fore- 
ground object(s) occupy a greater area than the other 
rows are corrected in the depth irrformation thereof for 
the following reason. 

[0237] In most cases. otDjects on the front of the scene 
are located on the lower side of the screen. In addition, 
images of objects located on the lower side of the 
screen, such as of ground and the like, often have little 
variations. The image with little variations like that of the 
ground has a low high-frequency component and there- 
fore, has a low depth information value despite being 
located to the front of the scene. Hence, the deptii cor- 
rection is provided in order to increase the depth infor- 
mation value of the image of the foreground object, 
which has a low high-frequency component, to a degree 
that the depth information value of such a region does 
not exceed that of a region thereabove. 

(7) Group-Boundary Depth Information Correction 
Processing 

[0238] In some cases, regions In a boundary portion 
between two adjacent groups may not be divided into 
correct groups. Further if. in the boundary portion 
between tiie adjacent groups, depth estimations of tiie 
respective groups have great difference from each 
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other, a serious image distortion results. 
[0239] Hence, the group-boundary depth information 
correction processing of Step 7 first checks a boundary 
portion between the respective pairs of adjacent groups 
to determine whether a difference between depth infer- s 
mation of parallax calculation regions of one group and 
that of regions of the other group exceeds a predeter- 
mined value or not If the difference in depth information 
between the two groups exceeds the predetermined 
value, the smaller depth information (or that of the par- io 
allax calculation regions corresponding to objects 
located relatively reanArardly) Is increased so that the 
difference in depth information therebetween may be 
less than the predetermined value. 

15 

(8) In-Group Depth Information Correction Processing 

[0240] The aforesaid correction processings of Steps 
6 and 7 may result in production of difference in the 
depth information of regions of the same group. If this 20 
difference is great, a serious image distortion results. 
Therefore, the in-group depth information connection 
processing of Step 8 smoothes out depth estimations 
with respect to regions of each group. 
[0241 ] It is assumed that a target region A has depth 25 
information HA while four regions U, D, L and R adja- 
cent thereto and included in tiie same group with the 
region A have depth information Hu. HD, HL and HR, 
respectively, as shown in Rg.41. The depth estimation 
HA of the target region A is corrected based on the fbl- 30 
lowing equation (10): 

HA=(HA/2)+{(HU+HD+HL+HR)/8) (10) 

[0242] Deptii information on the respective parallax 3S 
calculation regions F1-F60 tiius obtained are normal- 
ized again within the range of between 1 and 10. 

(9) Parallax Information Calculation Processing 

40 

[0243] In the parallax information calculation process- 
ing of Step 9. the depth information on the respective 
parallax calculation regions F1-F60 is converted into 
parallax information on the respective regions F1-F60. 
[0244] More specifically, based on a predetermined 45 
relation between the deptii Information and the parallax 
information, tiie depth information on each of the 
regions F1-F60 is converted into the parallax informa- 
tion on each of the regions. The relation of the parallax 
information versus the deptii information is inversely so 
proportional, as shown by a straight line SI or S2 in 
Fig.42, 

[0245] Referring to Fig.42, the relation of the parallax 
infornnation with the depth information represented by 
the straight line SI is used for obtaining a 3D image with ss 
a relatively great stereoscopic effect. On the other hand, 
the relation of the parallax information with the depth 
information represented by the straight tine S2 is used 



for obtaining a 3D image with a relatively small stereo- 
scopic effect. The stereoscopic effect can be adjusted 
by controlling the relation of the parallax information ver- 
sus the depth information in a range of between the 
straight lines 81 and S2. 

[0246] The parallax information per parallax calcula- 
tion region thus obtained is supplied to the parallax con- 
trol circuit 4 (see Fig.27). 

[0247] The configuration and operation of the parallax 
control circuit 4 according to the second embodiment 
hereof are the same with those of the parallax control 
a'rcutt according to the first embodiment shown in 
Figs.1 and 20 and therefore, the description thereof is 
omitted. 

[0248] The 2D/3D image conversion apparatus 
according to the above embodiment eliminates the 
need for the field memories for generating the image 
signal timed delayed relative to the original 2D image 
signal and hence, accomplishes the cost reduction. 
Additionally, the 2D/3D image conversion apparatus of 
the above embodiment is adapted to produce the stere- 
oscopic image even from the original 2D image signal 
representing the still image. 

[0249] Further, the perspective Image information on 
each group is generated after all tfie regions in the one- 
field screen are divided into groups associated with the 
respective objects in the screen. Therefore, variations in 
the parallax of different parts of the same object are 
reduced. As a result distortion of image portions repre- 
senting different parts of the same object is reduced so 
that a favorable stereoscopic image is provided. 

[3] Third Embodiment 

[0250] Now, a third embodiment of the invention will 
be described witii reference to Figs.21 . and 43 to 45. 
[0251 ] Fig.43 diagrammatically illustrates a construc- 
tion of a 2D/3D image conversion apparatus. In the fig- 
ure, like parts to those shown in Fig.1 are represented 
by like reference numerals, respectively. 
[0252] The luminance signal Y. and color difference 
signals R-Y and B-Y. which constitute the 2D image sig- 
nal, are converted by the AD conversion circuit 1 (ADC) 
into digital Y. R-Y and B-Y signals, respectively. 
[0253] Y signal is supplied to a motion vector sensing 
circuit 2 as well as to the first left-eye-image optional 
pixel delay FIFO 11 and the first right-eye-image 
optional pixel delay FIFO 21. R-Y signal is supplied to 
the second lefl-eye-image optional pixel delay FIFO 12 
and the right-eye-image optional pixel delay FIFO 22. B- 
Y signal is supplied to the third left-eye-image optionsU 
pixel delay FIFO 13 and the third right-eye-lmage 
optional pixel delay FIFO 23. 

[0254] The motion vector sensing circuit 2 calculates 
a motion vector of each of the twelve motion vector 
detection regions E-E12 (hereinafter referred to as "par- 
allax calculation region") on a field-by-fleld basis, the 
regions defined in the one-field screen, as shown in 
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Fig.21. The motion vector sensing circuit 2 supplies to 
the CPU 3 on a field-by-field basis, data Indicative of a 
region presenting a calculated motion vector of a low 
reliability (hereinafter referred to as "NG region"), X- 
motion vectors of any of the regions El -El 2 exclusive of 5 
the NG region, the maximum value of the X-motion vec- 
tors of any of the regions E1>E12 exclusive of the NQ 
region (including data of a region presenting the maxi- 
mum X-motion vector), tiie minimum value of the X- 
motion vectors of any of the regions El -E1 2 exclusive of 10 
the NG region (including data of a region presenting the . 
minimum X-motion vector), and an integration value of 
absolute values of the X-motion vectors of any of the 
re^'ons El -El 2 exclusive of the NG region. 
[0255] The CPU 3 calculates a deptfi value or a pro- is 
jection value of each of tiie parallax calculation regions 
E1-E12 based on the Information supplied by the 
motion vector sensing circuit 2. Based on the depth 
value or projection value thus determined, the CPU 3 
generates parallax Information on each of the parallax 20 
calculation regions E1-E12. In this example, the depth 
value per parallax calculation region E1-E12 is calcu- 
lated in a manner that a region including the back- 
ground may have a great depth value while a region 
including the subject may have a small depth value. A 25 
calculation method of the depth value will hereinafter be 
described in detail. 

[0256] The parallax information per parallax calcula- 
tion region E1-E12 calculated by the CPU 3 is supplied 
to the parallax control circuit 4. The parallax control cir- 30 
cuit 4, in turn, generates parallax information per pixel 
position in each field t>ased on the parallax information 
on each parallax calculation regions E1-E12. Based on 
the parallax information per pixel position thus obtained, 
the parallax control circuit 4 controls the read addresses 35 
of tiie lefl-eye-image optional pixel delays FIFOs 11-13 
and the right-eye-image optional pixel delays FIFOs 21- 
23 to read the image signal(Y. R-Y and B-Y signals) 
therefrom such that the addresses of FIFOs 11-13 are 
shifted from those of FIFOs 21-23, respectively. Hence. 40 
the left-eye image signal read out from the left-eye- 
image optional pixel delays FIFOs 11-13 has a different 
horizontal phase from the right-eye image signal read 
out from the right-eye-image optional pixel delays 
FIFOs-23. 45 
[0257] The left-eye Image signal (YL signal. (R-Y)L 
signal and (B-Y)L signal) read out from the left-eye- 
image optional pixel delays FIFOs 11-13 is converted 
into an analog signal by the DA conversion circuit (DAC) 
5 before supplied to the uniilustrated 3D display unit, so 
The right-eye image signal (YR signal. (R-Y)R signal 
and (B-Y)R signal) read out from the right-eye-image 
optional pixel delays FIFOs 21-23 is converted Into an 
analog signal by tiie DA conversion circuit (DAC) 6 
before supplied to tiie uniilustrated 3D display unit. ss 
[0258] Since the left-eye Image signal has a different 
horizontal phase from that of the right-eye image signal, 
a parallax is produced between the left eye image and 



the right eye image. Hence, by viewing the left eye 
Image with the left eye alone and the right eye Image 
witii the right eye alone, a stereoscopic image is estab- 
lished wherein the subject is located to the front against 
tiie background. 

[0259] Fig.44 is a diagram itlusti^ting a parallax infor- 
mation generation process performed by the CPU 3. 
[0260] Subject/background judging means 131 
checks the X-motion vector of each of the parallax cal- 
culation regions El -El 2 exclusive of the NG region to 
determine whether tiie image of each region represents 
a subject or a bad^round. The judging method may be 
exemplified by a method disclosed in Japanese Unex- 
amined Patent Publication No.8(1996)-149517. for 
example. 

[0261] Depth information generating means 132 
determines a depth value (depth information) per paral- 
lax calculation region E1-E12 based on tiie X-motion 
vector of each of the parallax calculation regions E1- 
E12 exclusive of the NG region, the maximum value of 
the X-motion vectors of the parallax calculation regions 
El -El 2 exclusive of tiie NQ region (Including data on a 
region presenting the maximum X-motion vector), tiie 
minimum value of the X-motion vectors of the parallax 
calculation regions E1-E12 exclusive of the NQ region 
(including data on a region presenting the minimum X- 
motion vector), and data indicative of the NQ region. 
[0262] More specifically, the depth information gener- 
ating means decides a stereoscopic position of either 
one of the parallax calculation regions presenting the 
maximum X-motion vector and tiie minimum X-motion 
vector to be at a screen-surface position PPF and a 
stereoscopic position of the other region to be at a rear- 
most position PPR. based on the judgments which the 
subject/background judging means 131 made on any of 
the parallax calculation regions E1-E12 except for the 
NG region, the maximum value of the X-motion vectors 
of any of the parallax calculation regions E1-E12 exclu- 
sive of the NQ region (including tiie data on the region 
presenting the maximum X-motion vector) and the min- 
imum value of the X-motion vectors of any of the paral- 
lax calculation region E1-E12 exclusive of the NG 
region (including the data on tiie region presenting the 
minimum X-motion vector). 

[0263] Where an image of tiie parallax calculation 
region with the maximum X-motion vector represents 
the subject while an image of tiie parallax calculation 
region witii the minimum X-motion vector represents the 
background, a stereoscopic position of the region with 
tiie maximum X-motion vector is determined to be at tiie 
screen-surface position PPF while a stereoscopic posi- 
tion of the parallax calculation region with the minimum 
X-motion vector is determined to be at tiie rearmost 
position PPR, as shown in Fig.45. 
[0264] Where an image of tiie parallax calculation 
region with the maximum X-motion vector represents 
tiie background while an image of the parallax calcula- 
tion region with the minimum X-motion vector repre- 
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sents the subject, a stereoscopic position of the parallax 
calculation region with the maximum X-motion vector is 
determined to be at the rearmost position PPR while a 
stereoscopic position of the parallax calculation region 
with the minimum X-motion vector is determined to be 
at the screen-surface position PPR 
[0265] The description on the method of determining 
the depth value of each parallax calculation region El - 
El 2 will herein be made on assumption that the image 
of the parallax calculation region with the maximum X- 
motion vector represents the subject while the Image of 
the parallax calculation region with the minimum X- 
motion vector represents the background whereby, as 
shown in Rg.45. the stereoscopic position of the paral- 
lax calculation region with the maximum X-motion vec- 
tor is at the screen-surface position PPF and that of the 
parallax calculation region with the minimum X-motion 
vector is at the rearmost position PPR. 
[0266] As to the parallax calculation regions other 
than the parallax calculation regions having the maxi- 
mum X-motion value and the minimum X-motion value 
and the NG region, respective stereoscopic positions 
such parallax calculation regions are determined to be 
somewhere between the screen-surface position PPF 
and the rearmost position PPR according to the respec- 
tive X-motion vectors thereof. In this example, the 
greater X-motion vector the region has. the doser to the 
screen-surface position PPF is the stereoscopic posi- 
tion of the region. On the other hand, the smaller X- 
motion vector the region has, the closer to the rearmost 
position PPR is the stereoscopic position of the region. 
[0267] A stereoscopic position of each NG region is 
determined based on which row of the screen includes 
the NG region: an upper row (regions E1-E4), an inter- 
mediate row (regions E5-E8) or a lower row (E9-E12) of 
the screen. 

[0268] A stereoscopic position of an NG region in the 
tower row of the screen is determined to be at an inter- 
mediate position Pa between the screen-surface posi- 
tion PPF and the rearmost position PPR. A 
stereoscopic position of an NG region in the upper row 
of the screen is determined to be at a position Pc equiv- 
alent to the rearmost position PPR. A stereoscopic posi- 
tion of an NO region in the intermediate row of the 
screen is determined to be at an intermediate position 
Pb between the stereoscopic position Pa of the NG 
region in the lower row of the screen and the stereo- 
scopic position Pc of the NG region in the upper row of 
the screen. 

[0269] Now a reason for determining the stereoscopic 
position of the NG region in the aforementioned manner 
will be described. It is presumed that the image of the 
NG region represents the background. Normally, a 
background image portion occupying a lower part of the 
screen correspondingly represents a nearer view, 
whereas a background image portion occupying a 
higher part of the screen correspondingly represents a 
more distant view. Hence, the stereoscopic position of 



each NG region is determined such that as the NG 
region is positioned higher with respect to the screen, 
tiie stereoscopic position thereof becomes more back- 
ward from the screen-surface position PPR Further, 

5 since the NG region is presumed to represent the back- 
ground, the NG region at the lower part of the screen is 
determined to have a stereoscopic position backward 
from that of a region representing the subject. 
[0270] Thus, the respective depth values (depth infbr- 

10 mation) of the parallax calculation regions El -E12 from 
the screen-surfece position PPF are determined by 
deciding the respective stereoscopic positions of the 
parallax calculation regions E1-E12. 
[0271] Depth Information selecting means 133 is sup- 

15 plied witii depth information on the parallax calculation 
regions El -El 2 of the present field, which information is 
generated by the depth information generating means 
132, and with depth information on the parallax calcula- 
tion regions E1-E12 of the preceding field, which infbr- 

2o mation is previously selected by the depth information 
selecting means 133. The depth information selecting 
means 133 is also supplied with data indicative of 
respective integration values of the absolute values of 
the X-nnotioil vectors of any of the parallax cateulation 

25 regions E1-E12 other than the NG region. 

[0272] When the integration values of the absolute 
values of the X-motion vectors of any of the parallax cal- 
culation regions E1-E12 other than the NG region are 
not less than a predetermined value, or when an umage 

30 motion of the present field is greater than that of the pre- 
ceding field, the depth information selecting means 133 
selectively outputs the depth information of the present 
field. When the integration values of the absolute values 
of the X-motion vectors of any of the parallax caknjiation 

35 regk)ns El -E12 other than the NG region are less than 
the predetermined value or when the image motion of 
the present field is smaller than that of the preceding 
field, the depth information selecting means selectively 
outputs the depth information of the preceding fieki. 

4o [0273] Depth information per parallax calculation 
region E1-E12 outputted from the depth information 
selecting means 133 (hereinafter referred to as lirst 
depth information per parallax calculation region E1- 
E12") is supplied to smoothing means 140 which, in 

45 turn, smoothes the depth information for prevention of 
abrupt change in the depth information between adja- 
cent fields. The smoothing means 140 includes a first 
multiplying means 134. a first adding means 135 and a 
second multiplying means 136. 

50 [0274] The first multiplying means 134 serves to mul- 
tiply the first depth information per parallax calculation 
region El -El 2 by a factor a, which is set to. for example, 
1/8. However, the factor a is set to 1 when a scene of 
the present field is changed from that of the preceding 

55 field (scene change). A method disclosed in Japanese 
Unexamined Patent Publication No.8(1996)-149514, for 
example, may be used for detecting such a scene 
change. 
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[0275] Output from the first multiplying means 134 
(hereinafter, referred to as "second depth information 
per parallax calculation region E1-E12'*) is supplied to 
the adding means 135, which Is also si^plied with out* 
put from the second multiplying means 136 (hereinafter, 
referred to as ''fourth depth information per parallax caf- 
culation region El -El 2"). The adding means 135 
serves to calculate a sum of the second depth informa- 
tion per parallax calculation region E1-E12 and the cor- 
responding fourth depth Information per parallax 
calculation region. 

[0276] The second multiplying means 136 serves to 
multiply the preceding output from the adding means 
135 (hereinafter, referred to as "third depth information 
per parallax calculation region E1-E12") by a factor p. 
which is normally set to 7/8. for example. However, the 
factor p is set to 0 when a scene of the present field is 
changed from that of the preceding field (scene 
change). 

[0277] That is, when the scene of the present field is 
not changed from that of the preceding field, the first 
multiplying means 134 multiplies, by 1/8. the first depth 
Information on each parallax calculation region El -El 2 
outputted from the depth information selecting means 
133. theret^y to give the second depth information per 
parallax calculation region El -El 2. 
[0278] The second depth information per parallax cal- 
culation region E1>E12 is supplied to the adding means 
135. The adding means 135 is also supplied with the 
fourth depth information per parallax calculation region 
El -El 2 which is determined by the second multiplying 
means 136 multiplying, by 7/8, the tiiird depth informa- 
tion per parallax calculation region E1-E12 previously 
outputted by the adding means 135. 
[0279] The adding means 1 35 adds together a second 
depth Information piece on each parallax calculation 
region El -El 2 and a corresponding fourth depth infor- 
mation piece on each parallax calculation region E1- 
El 2. Thus is obtained the third depth irrformation per 
parallax calculation region El -El 2. which is supplied as 
the parallax information to the parallax control circuit 4 
(see ng.43). 

[0280] Where the scene of the present field is 
changed from that of the preceding field, the first multi- 
plying means 134 multiplies by 1 the depth information 
piece on each parallax calculation region E1-E12 out- 
putted from the depth information selecting means 133. 
That is, the first multiplying means 134 outputs the 
depth information per parallax calculation region E1- 
E12 which is at the same value as tine deptii information 
supplied from the depth Information selecting means 
133. 

[0281 ] The second multiplying means 1 36 has the fac- 
tor of 0, thus providing an output of 0. Therefore, the 
adding means 135 outputs the deptii information per 
parallax calculation region El -E12 which is thesame as 
the deprth information outputted Irom the depth informa- 
tion selecting means 133. That is. where the scene of 



the present field is changed from that of the preceding 
field, the depth information per parallax calculation 
region El -El 2 outputted from the depth information 
selecting means 133 is supplied as the parallax infor- 

5 mation to the parallax control circuit 4 (see Fig.43). 
[0282] A configuration and operation of the parallax 
control drcult 4 according to the third embodiment 
hereof are the same as tiie parallax control circuit 
according to the first embodiment hereof shown in 

10 Figs.1 and 20. Therefore, the description thereof is 
omitted. 

[0283] The aforementioned 2D/3D image conversion 
apparatus negates the need for the field memories for 
generating the Image signal time-delayed restive to the 
15 original 2D image signal, thus accomplishing the cost 
reduction. 

[4] Fourth Embodiment 

20 [0284] Now referring to Figs.46 to 51 . a fourth embod- 
iment of the invention will be described. 

[4-1] Description on the embodiment where the inven- 
tion is applied to a 2D/3D image conversion system. 

25 

[0285] Fig.46 is a block diagram showing a construc- 
tion of the 2D/3D Image conversion system. 
[0286] The 2D/3D image conversion system includes 
a 2D/3D image converter 501 for converting 2D images 
30 into 3D images and a stereoscopic effect adjusting dr- 
cuit 502 for rriaking adjustment to tiie stereoscopic 
effect of 3D image signal obtained by ttie 2D/3D image 
coriverter 501. 

[0287] The 2D/3D image converter 501 is supplied 
35 with a luminance signal Y-IN, and color difference sig- 
nals (R-V)-IN and (B-Y)-tN, which signals compose the 
2D image signal. The 2D/3D image converter 501 out- 
puts a luminance signal YL and color difference signals 
(R-Y)L and (B-Y)L. which signals composes a left-eye 
40 image signal: a luminance signal YR and color differ- 
ence signals (R-Y)R and (B-Y)R. which signals com- 
pose a right-eye Image signed; and parallax information 
PR per pixel. 

[0288] The respective output signals from the 2D/3D 
45 image converter 501 are sent to the stereoscopic effect 
adjusting circuit 502. which, in turn, outputs a luminance 
signal YL-OUT and color difference signals (R-Y)L-OUT 
and (B-Y)L-OUT which signals compose a left-eye 
image signal with the stereoscopic effect adjusted, as 
50 well as a luminance signal YR-OUT and color difference 
signals (R-Y)R-OUT and (B-Y)R-OUT which signals 
compose a right-eye image signal witii the stereoscopic 
effect adjusted. 

[0289] As the 2D/3D image converter 501, tiiere 
55 maybe used, for example, the 2D/3D image conversion 
apparatus of the first embodiment hereof (see Rg.1). 
the 2D/3D image conversion apparatus of tiie second 
embodiment hereof (see Fig.27) or the 2D/3D image 
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conversion apparatus of the third embodiment hereof 
(see Fig.43). 

[0290] Fig. 47 diagrammabcally illustrates a configura- 
tion of the stereoscopic effect adjusting circuit 502. 
[0291] The stereoscopic effect adjusting circuit 503 5 
includes a factor generating circuit 601 , a ieft-eye-image 
stereoscopic effect adjusting circuit 602 for making 
adjustment to the stereoscopic effect of the left-eye 
image signal, and a right*eye-image stereoscopic effect 
adjusting circuit 603 for making adjustment to the stere- 
oscopic effect of the right-eye image signal. 
[0292] The left-eyenmage stereoscopic effect adjust- 
ing circuit 602 is configured the same way as the right- 
eye-image stereoscopic effect adjusting circuit 603 and 
therefore, the description will be made only on the left- 
eye-image stereoscopic effect adjusting means 602. 
[0293] The factor generating circuit 601 generates a 
first fector KL, a second tactor KH and a third factor KC 
based on the parallax information per pixel PR (informa- 
tion on the perspective image characteristics) supplied 
from the 2D/3D image converter 501 . The first factor KL 
is generated within the range of not less than 0 and not 
more than 1 (Or^KL^I) and used for adjusting a propor- 
tion of a low-frequency connponent of the image signal. 
More specifically, the first factor KL is used for blurring 
an image contour or reducing a sharpness of the image 
contour. The greater the value of the first tector KL, the 
more blurred the resultant image. 
[0294] The factor generating circuit 601 generates the 
first factor KL such that the first factor KL is at a smaller 
value for a pixel forming an image positioned to the front 
but is at a greater value for a pixel forming an image 
positioned to the back According to this embodiment, 
as mentioned above, the parallax information PR is at a 
smaller value for the pixel forming the image positioned 
to the front but at a greater value for the pixel forming 
the image positioned to the back. Hence, as shown in 
Fig.48, the factor generating circuit 601 is adapted to 
provide the first factor KL of 0 corresponding to the par- 
allax information PR of a predetermined value or less, 
but to progressively increase the value of the first fector 
KL with increase in the parallax information PR which 
exceeds the predetermined value. 
[0295] The second factor KH is generated in the range 
of not less than 0 and not more than 1 (O^KH^I) and is 
used for adjusting a proportion of a high-frequency 
component of the image signal. More ^ecifically. the 
second factor KH is used for sharpening the image con- 
tour or for enhancing the sharpness of the image con- 
tour. The greater is the value of the second factor KH. 
the sharper contour has the resultant image. 
[0296] The factor generating circuit 601 generates the 
second factor KH such that the second factor KH Is at a 
greater value for the pixel forming the image positioned 
to the front but at a smaller value for the pixel forming 
the image positioned to the back. According to this 
embodiment, as mentioned above, the parallax informa- 
tion PR is at a smaller value for the pixel forming the 



image positioned to the front but at a greater value for 
the pixel forming the image positioned to the back. 
Hence, as shown in Fig.49, the factor generating circuit 
601 is adapted to progressively decrease the value of 
the second fector KH as the parallax information PR 
increases up to a predetermined value but to provide 
the second factor KH of 0 con'esponding to the parallax 
information PR excessive of the predetermined value. 
[0297] The third factor KC is used for adjusting the 
image chroma. The greater the value of the third factor 
KC. the more enhanced the image chroma. The factor 
generating circuit 601 generate the third factor KC 
such that the third factor KC is at a greater value for the 
pixel fonning the image positioned to the front but at a 
smaller value for the pixel fornang the image positioned 
to the back According to this embodiment, as men- 
tioned above, the parallax information PR is at a smaller 
value for the pixel forming the Image positioned to the 
front but at a greater value for the pixel forming the 
image positioned to the back Hence, as shown in 
Fig.50, the factor generating circuit 601 is adapted to 
progressively decrease the value of the third factor KC 
with increase in the parallax information PR. 
[0298] The left-eye-image stereoscopic effect adjust- 
ing circuit 602 is supplied with the luminance signal YL 
and color difference signals (R-Y)L and (B-Y)L from the 
2D/3D Image converter 501 . the luminance signal and 
color difference signals composing the left-eye image. 
[0299] The left-eye-image stereoscopic effect adjust- 
ing circuit 602 includes a circuit 610 for adjusting the 
sharpness of the image contour, and a circuit 620 for 
adjusting the image chroma. 

[0300] Now. the circuit 61 0 for adjusting the sharpness 
of the image contour will be described. The circuit 610. 
for adjusting the sharpness of the image contour 
includes a circuit 61 1 for adjusting the proportion of the 
low-frequency component of the image, a drcuit 612 for 
adjusting the proportion of the high-frequency conpo- 
nent of the image, and an adder drcuit 613 for adding 
together outputs from these circuits. 
[0301] The circuit 61 1 for adjusting the proportion of 
the proportion of the low-frequency connponent of the 
image includes a lovv-pass filter (LPS) 701 for extracting 
the low-frequency component of the luminance signal 
YL; a first multiplier 702 for multiplying, by the first factor 
KL, the low-frequency component of the luminance sig- 
nal YL extracted by the low-pass filter 701 ; a functional 
unit 703 for performing 1-KL operation; a second multi- 
plier 704 for multiplying the luminance signal YL by (1- 
KL) which is an output from the functional unit 703; and 
a first adder 705 for adding together outputs from the 
first multiplier 702 and the second multiplier 704. 
[0302] The circuit 612 for adjusting the proportion of 
the high-frequency conponent of the image includes a 
high-pass filter (HPF) 71 1 for extracting the high-fre- 
quency component of the luminance signal YL, and a 
third multiplier 712 for multiplying, by the second factor 
KH, the high-frequency component of the luminance 
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signal YL extracted by the high-pass filter 71 1 . 
[0303] An output from the circuit 61 1 for adjusting the 
proportion of the low-frequency component of the 
Image (output from the first adder 705) and an output 
from the circuit 612 for adjusting the proportion of the 5 
high-frequency component of the image (output from 
the third multiplier 71 2) are added together by the adder 
Q'rcuit 613. An output YL-OUT from the adder circuit 
613 is supplied to an unlllustrated 3D display unit. 
[0304] As mentioned in the foregoing, the pixel form- io 
ing the image positioned to the front is decreased in the 
value of the first factor KL but increased in the value of 
the second factor KH. Accordingly, the pixel forming the 
image positioned to the front Is decreased in the propor- 
tion of the low-frequency component of the luminance is 
signal YL but increased in the proportion of the high-fre- 
quency component of the luminance signal YL There- 
fore, the pixels corresponding to the Image positioned to 
the front produce the image in a sharp contour. 
[0305] On the other hand, the pixel forming the image 20 
positioned to the back is increased in the value of the 
first factor Kl but decreased in the value of the second 
factor KH. Accordingly, the pixel forming the image posi- 
tioned to the back is increased in the proportion of the 
low-frequency component of the luminance signal YL 25 
but decreased in the proportion of the high-frequency 
component of tiie luminance signal YL. Therefore, the 
pixels corresponding to the image positioned to the 
k>ack produce the image in a blurred contour. That is, the 
pixels corresponding to the image positioned to the front 30 
produce the image in the sharp contour while the pixels 
corresponding to the image positioned to the back pro- 
duce the image in the blurred contour. As a result, the 
stereoscopic effect is enhanced. 

[0306] Now, the circuit 620 for adjusting the image 35 
chroma will be described. The circuit 620 for adjusting 
the Image chroma includes a fifth multiplier 721 for mul- 
tiplying the color difference signal (R-Y)L by the third 
factor KC, and a sixth multiplier 722 for multiplying the 
color difference signal (B-Y)L by the third factor KC. An 40 
output from the fifth multiplier 721 (R-Y)L-OUT arKi an 
output from the isixtii multiplier 722 (B-Y)L-OUT are sup- 
plied to the unillustrated 3D display unit. 
[0307] As described above, the pixel forming the 
image positioned to the front is inaeased in tiie value of 4S 
the third factor KC. Accordingly, the pixel forming the 
image positioned to the front is increased in the values 
of the color difference signals (R-Y)L and (B-Y)L, thus 
increased in chroma. In contrast, the pixel forming the 
image positioned to ttie back is decreased in the value so 
of the third factor KC. Accordingly, the pixel forming the 
image positioned to the back is decreased in the values 
of the color difference signals (R-Y)L and (B-Y)L , thus 
decreased in chroma. Thus, the pixels forming the 
image positioned to the front have increased chroma ss 
whereas the pixels forming the image positioned to the 
back have decreased chroma. As a result, the stereo- 
scopic effect is enhanced. 



[4-2] Description on the embodiment where the inven- 
tion is applied to a system for adjusting the stereoscopic 
effect of the 3D image signal composed of the left-eye 
image signal and the right-^e Image signal picked up 
by two cameras. 

[0308] Rg.51 diagrammatically illustrates a construc- 
tion of a stereoscopic effect adjusting system. 
[0309] The stereoscopic effect adjusting system 
includes a parallax detecting circuit 801 for detecting 
tiie parallax information PR per pixel on a f leld-by-field 
basis, and a stereoscopic effect adjusting circuit 802 for 
mEddng adjustmerrt to the stereoscopic effect of the 3D 
image signal based on the parallax Irrformation PR per 
pixel obtained by the parallax detecting circuit 801 . 
[0310] The parallax detecting circuit 801 includes a 
selecting circuit 901, a motion vector sensing circuit 
902, a vector correcting circuit 903 and a parallax infor- 
mation generating circuit 904. 

[0311] The selecting circuit 901 is supplied with the 
left-eye-image luminance signal YL-IN and the right- 
eye-image luhninance signal YR-IN. which luminance 
signals YL-IN and YR-IN compose the 3D image. The 
selecting circuit is also supplied with afield idernification 
signal FLD as a control signal. 

[0312] The selecting drcuit 901 outputs the left-eye- 
image luminance signal YL-IN and the right-eye-innage 
luminance signal YR-IN as switching, based on the field 
identification signal FLD, between the left-eye-image 
luminance signal and the right-eye-image luminance 
signal on afleld-by-field basts. In this example, the field 
identification signal FLD is at H-level when the input 
image signal is in an odd field and at L-level when the 
input image signal is in an even field. When the field 
identification signal FLD is at H-level (odd field), the 
selecting drcuit 901 selectively outputs the left-eye- 
image luminance signal YL-IN. When the field identifica- 
tion signal FLD is a L-level (even field), the selecting cir- 
cuit selectively outputs the right-eye-image luminance 
signal YR-IN. 

[031 3] The motion vector sensing drcuit 902 performs 
calculation on a field-by-field basis to determine, from 
the image signal outputted from the selecting circuit 
901 . an X-motion vector of each of the twelve motion 
vector detection regions (hereinafter, referred to as 
"parallax calculation region") El -El 2 defined in the one- 
field screen, as shown in Fig.21. 
[0314] The X-motion vector per parallax calculation 
region El -El 2 given by the motion vector sensing cir- 
cuit 902 is supplied to the vector correcting drcuit 903. 
The X-motion vector per parallax calculation region E1- 
E12 obtained by the motion vector sensing circuit 902 
represents a horizontal image motion between the left- 
eye image and the right-eye image per parallax calcula- 
tion region El -El 2. Since the left-eye image and the 
right-eye image have a parallax therebetween, both the 
images, representing the same object, have horizontal 
positions different from each other depending upon dis- 
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tances from the cameras. Hence, the X-motion vector 
per parallax calculation region E1-E12 corresponds to 
the parallax between the both images per parallax cal- 
culation region E1-E12. 

[0315] However, with respect to an object moving in 5 
the same direction, an X-vedor obtained by shifting 
from the left-eye image to the right-eye image has an 
opposite sign to an X-motion vector obtained by shifting 
from the right-eye Image to the left-eye Image. Hence, 
the vector correcting circuit 903 Is provided for agree- io 
ment of the sign of the X-vectors obtained with respect 
to the object moving in the same direction. 
[031 6] When the field identification signal FLD is at H- 
level (odd field), the vector correcting circuit 903 
receives the X-motion vector per parallax calculation is 
region El -El 2 from the motion vector sensing circuit 
902 and sends the X-motion vector, in the as-is state, to 
the parallax information generating drcuit 904. 
[031 7] When the field identification signal FLD is at L- 
levei (even field), the vector correcting circuit 903 20 
receives the X-motion vector per parallax calculation 
region El -El 2 from the motion vector sensing circuit 
902 and inverts the sign of the X-nx)tion vector per par- 
allax calculation region before sending the same to the 
parallax information generating drcuit 904. 25 
[031 8] Hie parallax information generating circuit 904, 
in turn, generates the parallax information PR per pixel 
based on the X-motion vector per parallax calculation 
region E1 -£12 thus supplied from the vector correcting 
circuit 903. 30 
[031 9] More specifically, the parallax infonmation gen- 
erating circuit uses the X-motion vector per parallax cal- 
culation region E1-E12, supplied from the vector 
correcting drcuit 903. as the parallax information per 
parallax calculation region E1-E12 for generating the 35 
parallax information per pixel PR in the same manner as 
described with reference to Rg.21 . 
[0320] Based on the parallax information per pixel PR 
obtained by the parallax detecting circuit 801 , the stere- 
oscopic effect adjusting circuit 802 performs a process- 40 
ing for correcting the stereoscopic effect of the 3D 
image signal. The stereoscopic effect adjusting means 
802 is identical to the stereoscopic effect adjusting dr- 
cuit 502 shown in Flg.46 and therefore, the description 
on the configuration and operation thereof is omitted. 45 
[0321 ] The aforementioned fourth errfeodiment hereof 
allows for the adjustment to the stereoscopic effect 
offered by the 3D image signal. 



[5] Fifth Embodiment 
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[0322] Now referring to Figs.52 to 55, a fifth embodi- 
ment of the invention will be described. 
[0323] Fig .52 is a block diagram showing a construc- 
tion of a 2D/3D image converter of this embodiment. 55 
[0324] The 2D/3D image converter includes an inte- 
grated circuit (LSI) 1010 for converting 2D images into 
3D images, and a plurality of delay field memories 1020 



connected to the integrated circuit 1010. 
[0325] Fig.52 illustrates only a part of the integrated 
drcuit 1010 components that is involved in the writing of 
data to and the reading of data from the delay field 
memories 1020. More spedficaily. there are shown a 
write data path 1011, a write timing generating section 
1012, a read data path 1013 and a read timing generat- 
ing section 1014 as the components of the integrated 
drcurt 1010. Besides these components, the Integrated 
drcuit 1010 includes a motion vector detecting section, 
an interface connected to a CPU and the like. 
[0326] The integrated circuit 1010 is supplied with a 
luminance signal (Y signal) and color difference signals 
(R-Y and B-Y signals), which signals compose the 2D 
image signal. Tlie integrated circuit 1010 outputs the 
right-eye image signal and the left-eye image signal 
which have time difference relatively from each other 
The right-eye image signal is composed of a right-eye 
luminance signal Y(R) and rigfit-eye color difference 
signals R-Y(R)and B-Y(R) whereas the left-eye Image 
signal is composed of a left-eye luminance signal Y{L) 
and left-eye color difference signals R-Y(L) and B-Y(L). 
[0327] The 2D/3D image converter has three 2D/3D 
image conversion modes. 

(1) Rrst Normal Mode 

[0328] The first normal mode is arranged such that the 
3D innage signal having the same horizontal and vertical 
frequencies with the 2D image signal is generated 
based on the 2D image signal which has either one of 
the right-eye image signal and the left-eye image signal 
thereof supplied to the read data path 1013 without 
using the field memories. 

(2) Second Normal Mode 

[0329] The second normal mode is arranged such that 
the 3D image signal having the same horizontal and 
vertical frequencies with the 2D image signal is gener- 
ated based on the 2D image signal wNch has both the 
right-eye image signal and the left-eye image signal 
thereof supplied to the read data path 101 3 via the field 
memories. 

(3) Double Speed Mode 

[0330] The double speed mode is arranged so as to 
generate the 3D image signal, a horizontal and a verti- 
cal frequency of which are twice the respective frequen- 
des of the 2D image signal. In this case, the 3D image 
signal is generated based on the 2D image signal which 
has both the right-eye image signal and the left-eye 
image signal thereof supplied to the read data path 
1013 via the field memories. 

[0331] The integrated drcuit 1010 is supplied with a 
first reference dock signal CLK1 generated based on 
the horizontal synchronizing signal HSYNC of the 2D 
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image signal, a second reference clock signal CLK2 
generated based on the horizontal synchronizing signal 
HSYNC of the 2D image signal, a vertical synchronizing 
signal VSYNC of the 2D image signal, a first horizontal 
synchronizing signal HD1 generated based on the hori- 
zontal synchronizing signal HSYNC of the 2D image 
signal as timed to the first reference clock signal CLK1 . 
and a second horizontal synchronizing signal HD2 gen- 
erated based on the horizontal synchronizing signal 
HSYNC of the 2D image signal as timed to the second 
reference clock signal CLK2. 

[0332] Fig.53 diagrammatical ly illustrates a phase- 
locked circuit (PLL circuit) for generating the first refer- 
ence clock signal CLK1 and the first horizontal synchro- 
nizing signal HD1. 

[0333] An input to the phase-locked circuit is the hori- 
zontal synchronizing signal HSYNC of the 2D image 
signal whereas an output of the phase-locked circuit is 
the first horizontal synchronizing signal HD1 . A result of 
comparison between the horizontal synchronizing sig- 
nal HSYNC as the input to the phase-locked circuit and 
the first horizontal synchronizing signal HD1 as the out- 
put from the phase-locked drcuit is concerted into volt- 
age by a phase comparing section 1031. An output 
voltage from the phase comparing section 1031 is 
smoothed by a low-pass filter (LPF) 1032 before sup- 
plied to a voltage-controlled oscillator (VOC) 1033. The 
voltage-corrtrotled oscillator 1033 outputs a signal at a 
frequency depending upon an incoming voltage. 
[0334] An output (signal a) from the voltage-controlled 
oscillator 1033 is fetched as the first reference dock sig- 
nal CLK1 and applied to a 2-divider circuit 1034. The 2- 
divider drcuit 1 034 outputs a signal "b". a frequency of 
which is reduced to half of that of the output signal ''a'* of 
the voltage-controlied oscillator 1033. The output signal 
t)** of the 2-divkjer drcuit 1034 is applied to a 910- 
divider circuit 1035 whfch, in turn, outputs the signal 
HD1 having a frequency reduced to 1/910 of that of the 
output signal "b" of the 2-divider drcuit 1035. 
[0335] When a phase difference between the input 
and the output of the phase-locked drcuit is zero, the 
output signal (the first reference clock signal CLK1) of 
the voltage-controlled oscillator 1033 has a frequency 
fcLKi (15.75[kHz]) which is 1820 times the frequency fn 
of the horizontal synchronizing signal HSYNC. That is, 
the frequency Iclki reference dock signal 

CLX1 is at 1820 fH, or afcK)ut 28.6 [MHz]. 
[0336] TTie first reference dock signal CLK1 is 
obtained by dividing one period of the horizontal syn- 
chronizing signal HSYNC of the 2D image signal into 
1820 docks. In a case where a VTR reproduces an 
image from the 2D Image signal, the horizontal synchro- 
nizing signal HSYNC may be varied in the frequency. 
The frequency of the first reference clock signal CLK1 
varies according to the variations in the frequency of the 
horizontal synchronizing signal HSYNC. 
[0337] The second reference clock signal CLK2 and 
the second horizontal synchronizing signal HD2 are 



generated by a similar phase-locked circuit to that 
shown in Rg.53. When the phase difference between 
the input and output of the phase-locked drcuit is zero, 
the second reference clock signal C\J<2 has a fre- 

5 quency fcLK2 (15.75 [kHz]) which is 1820 limes the fre- 
quency f^ of the horizontal synchronizing signal 
HSYNC. That is. the frequency of the second reference 
dock signal CLK2 is at 1820 fn. or about 28.6 [Mhz]. 
[0338] In the phase-locked circuit for generating the 

10 second reference dock signal CLK2 and the second 
horizontal synchronizing signal HD2, a low-pass filter 
(LPF) has a cutoff frequency set to a lower value than 
that of the low-pass filter (LJ'F) 1032 shown in Fig.53. 
Therefore, the second reference dock signal CLI^ is 

15 less susceptible to frequency variations if the horizontal 
synchronizing signal HSYNC is varied in frequency. 
[0339] As shown in Rg.52. the frequency of the first 
reference clock signal CLXI is divided into a half by the 
2-divider drcuit 1015. Outputted from the 2-divider cir- 

20 cuit 1015. a third clock signal CLK3 is supplied to the 
write timing generating section 1012 and to a first selec- 
tor 1016. The third clock signal CLK3 has a frequency 
*CLK3 which is half the frequency fctxi ^ the first refer- 
ence clock signal CLK1. 

25 [0340] The reference clock signal CLK2 is supplied to 
the first selector 1016 as well as to a 2-divider circuit 

101 7. Outputted from the 2-divider circuit 1017, a fourth 
dock signal CLK4 is supplied to the first selector 1016. 
The fourth clock signal CLK4 has a frequency fci_K4 

30 which is half the frequency fcLK2 ^ the second refer- 
ence clock signal CLK2. 

[0341] The vertical synchronizing signal VSYNC is 
supplied to the write timing generating section 1012 and 
the read timing generating section 1014. The first hori- 
35 zontal synchronizing signal HD1 is suppfied to tiie write 
timing generating section 1012 and a second selector 

1018. The second horizontal synchronizing signal HD2 
is supplied to the second selector 1018. 

[0342] The first selector 1016 selects one from the 
40 third dock signal CLK3, the second reference dock sig- 
nal CLK2 and the fourth dock signal CLK4 according to 
a set rixxte for 2D/3D image conversion and applies the 
selected signal to the read timing section 1014. 
[0343] The second selector 1018 selects either one of 
45 the first horizontal synchronizing signal HD1 and the 
second horizontal synchronizing dgnal HD2 according 
to set mode for 2D^D image conversion and applies the 
selected signal to the read timing generating section 
1014. 

50 [0344] In tiie case of the first normal mode for 2D/3D 
image conversion, the first selector 1016 selectively 
supplies the third dock signal CLK3 to the read timing 
section 1014. In this case, the third clock signal CLK3. 
which is the first reference clock signal CLK1 divided 

55 into a half, is used as the write dock and read dock for 
the field memories 1020. Accordingly, the integrated cir- 
cuit 1010 operates the same way as the integrated dr- 
cuit 1100 shown in Fig-55. 
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[0345] In the case of the second normal mode for 
2D/3D image conversion, the first selector selectively 
supplies the fourth dock signal CLK4 to the read timing 
generating section 1014. In this case, the third docksig- 
nal CLK3, which is the first reference clock divided into 
a half, is used as the write clock for the field memories 
1020 whereas the fourth clock signal CLK4. which is the 
second reference clock signal CLK2 divided into a half, 
is used as the read clock for the field memories 1020. 
Accordingly, if the horizontal synchronizing signal 
HSYNC of the 2D image signal is varied in frequency, jit- 
ter may be accommodated. 

[0346] In the case of the double speed mode for 
2D^D image conversfon, the first selector 1016 selec- 
tively supplies the second reference clock signal CLK2 
to the read timing generating section 1014. In this case, 
the third clock signal CLK3, which is the first reference 
cbck signal CLK1 divided into a half, is used as the 
write clock for the field memories 1020 whereas the 
second reference clock signal CLK2 is used as the read 
clock for the field memories 1 020. 
[0347] More specifically, when the 2D/3D image con- 
version is performed in the double speed mode, the 
read clock for the field memories 1 020 has a frequency 
twice the frequency of the write clock. Accordingly, the 
integrated circuit 1010 outputs the 3D image signal, a 
horizontal and a vertical frequency of which are twice as 
great as those of the 2D image signal. Additionally, if the 
horizontal synchronizing signal HSYNC of the 2D image 
signal is varied in frequency, the jitter may be accommo- 
dated. 

[0348] Rg.54 is a timing chart showing signals in 
respective parts of tiie 2D/3D image converter in the 
double speed mode. It is to be noted that Rg.54 shows 
an ^cample wherein four delay field memories are pro- 
vided and the left-eye image signal is delayed from the 
right-eye image signal by two fields. 
[0349] Unlike the prior-art 2D^D image converter 
shown in Fig.55. the image converter of this embodi- 
ment negates the need for a doubling drcuit, thus 
accomplishing a simplified circuit configuration and cost 
reduction. 

Claims 

1. An apparatus for converting two-dimensional 
images irrto three-dimensional images comprising: 

characteristic value extracting means for 
extracting, from an inputted two-dimensional 
image signal, a perspective' Image characteris- 
tic value of each of plural parallax calculation 
regions defined in a one-field screen on afleld- 
by-field basis; 

parallax information generating means for gen- 
erating parallax information on each of prede- 
termined unit areas in the one-field screen by 
using the image characteristic value extracted 



per parallax calculation region; and 
phase control means for generating a first 
image signal and a second image signal from a 
signal of the Inputted tivo-dimensional fanage 
5 signal which resides in each predetermined 

unit area, the first and second Image signals 
having a horizontal phase difference tiierebe- 
tween based on the parallax information 
related to the predetermined unit area. 

10 

2. An apparatus for converting the two-dimensional 
images into the three<iirnensionai images as set 
forth In Claim 1, wherein the parallax information 
generating means includes: 

IS 

means for generating perspective image infor- 
mation per parallax calculation region by using 
the perspective image characteristic value of 
each parallax calculation region; and 
so means for converting the perspective image 

information per parallax calculation region into 
parallax information per parallax calculation 
region. 

25 3. An apparatus for converting the two-dimensional 
images Into the three-dimensional images as set 
forth in Claim 1. wherein the parallax information 
generating means includes: 

30 means for generating perspective Image infor- 

mation per parallax calculation region by using 
the perspective image characteristic value of 
each parallax calculation region; 
means for correcting a perspective image infor- 
35 mation piece on a parallax calculation region 

which is included in a group of parallax calcula- 
tion regions located vertically lower in screen 
than a parallax calculation region having a per- 
spective image information piece Indicative of 
4o the nearest perspective position and which has 

a perspective image information piece iridlca- 
tive of a perspective position a predetermined 
value or more farther from a perspective posi- 
tion indicated by a perspective image informa- 
45 tion piece on a parallax calculation region 

immediately thereabove, the perspective 
image information piece on the former parallax 
calculation region being corrected to indicate a 
perspective position closer to that indicated by 
50 the perspective image information piece on the 

latter parallax calculation region; and 
means for converting the corrected perspective 
image information piece on each parallax cal- 
culation region into a parallax information piece 
55 on each parallax calculation region. 

4. An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 
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forth in Claim 1, wherein the parallax information 
generating means includes: 

first means for dividing all the parallax calcula- 
tion regions in the one-field screen into groups s 
associated with respective objects included in 
the one-field screen by using the perspective 
Image characteristic value of each parallax cal- 
culation region; 

second means for generating perspective io 
image information per group by using grouping 
results given by the first means and the per- 
spective image characteristic value of each 
parallax calculation region; 
third means for generating perspective image is 
information per parallax calculation region by 
using the perspective image information per 
group; and 

fourth means for converting the perspective 
image information per parallax calculation 20 
region into parallax information per parallax 
calculation region. 

An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 25 
forth in Oaim 4. wherein the first means divides all 
the regions in the one-field screen into groups 
based on a histogram showing a number of parallax 
calculation regions for each perspective image 
characteristic value, each group including parallax 30 
calculation regions with perspective image charac- 
teristic values close to one another. 

An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 3s 
forth in Claim 4. wherein the first means includes: 

means for dividing all the regions in the one- 
field screen into groups t>ased on a histogram 
showing a number of parallax calculation 40 
regions for each perspective Image character- 
istic value, each group including parallax calcu- 
lation regions with perspective image 
characteristic values close to one another; and 
means which, when a single group includes a 4S 
plurality of regions spatially separated from 
each other, divides the spatially separated 
regions into different groups. 

An apparatus for converting the two-dimensional so 
images Into the three-dimensional images as set 
forth in Claim 4, wherein the first means includes: 

means for dividing all the regions in the one- 
field screen into groups based on a histogram ss 
showing a number of parallax calculation 
regions for each perspective image character- 
istic value, each group including parallax calcu- 



lation regions with perspective image 
characteristic values close to one another; 
means which, when a single group includes a 
plurality of regions spatially separated from 
each other, divides the spatially separated 
regions into different groups; and 
means which, when there is a group including a 
predetermined number of parallax calculation 
regions or fewer , checks perspective image 
characteristic values of the parallax calculation 
regions of the group and parallax calculation 
regions adjacent to the group to determine 
whether or not to combine the group with any 
one of neighboring groups, and combines the 
group with the neighboring group when the 
group is determined to be combined therewith. 

An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 
forth in Claim 4, wherein the first means includes: 

means for dividing all the regions of the one- 
field screen into groups based on a histogram 
showing a number of parallax calculation 
regions for each perspective image character- 
istic value, each group including parallax calcu- 
lation regions with perspective image 
characteristic values close to one another; 
means which, when a single group includes a 
plurality of regions spatially sepeuratiad from 
each other, divides the spatially separated 
regions into different groups; 
means which, when there is a group including a 
predetermined number of parallax calculation 
regions or fower, checks perspective image 
characteristic values of the parallax calculation 
regions of the group and parallax calculation 
regions adjacent to the group to determine 
whether or not to combine the group with any 
one of neighboring groups, and combines the 
group with the neighboring group when the 
group is determined to be combined therewith; 
and 

means which checks perspective image char- 
acteristic values of parallax calculation regions 
of adjacent groups to determine whetiier to 
combine them together or not, and combines 
the two groups together when they are deter- 
mined to be combined together. 

An apparatus for converting the two-dimensional 
Images into the three-dimensional images as set 
forth in Claim 4, wherein the second means calcu- 
lates the perspective image information per group 
by using the perspective image characteristic value 
of each parallax calculation region of each group 
and a weighting factor previously defined for each 
parallax calculation region. 
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10. An apparatus for converting the two-dimensional 
Images into the three-dimensional images as set 
forth in Claim 4, wherein the third means includes 
means for correcting a perspective image informa- 
tion piece on a parallax calculation region which is 5 
included in a group of parallax calculation regions 
located vertically lower in screen than a parallax 
calculation region having a perspective image infor- 
mation piece indicative of the nearest perspective 
position and which has a perspective Image infor- w 
mation piece indicative of a perspective position a 
predetermined value or more farther from a per- 
spective position indicated by a perspective image 
information piece on a parallax calculation region 
immediately thereabove, the perspective irnage 15 
information piece on the former parallax calculation 
region being corrected to indicate a closer perspec- 
tive position to that indicated by the perspective 
image information piece on the latter parallax calcu- 
lation region. 20 

11. An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 
forth in Claim 4. wherein the third means includes: 

25 

means for correcting a perspective image infor- 
mation piece on a parallax calculation region 
which is included in a group of parallax calcula- 
tion regions located vertically lower in screen 
than a parallax calculation region having a per- so 
spective image information piece indicative of 
the nearest perspective position and which has 
a perspective image information piece indica- 
tive of a perspective position a predetermined 
value or more farther from a perspective posi- 35 
tion indicated by a perspective image informa- 
tion piece on a parallax calculation region 
immediately thereabove, the perspective 
image information piece on the former parallax 
calculation region being corrected to indicate a 4o 
closer perspective position to that indicated by 
the perspective image information piece on the 
latter parallax calculation region; and 
means for correcting perspective irrage infor- 
mation pieces on respective pairs of parallax 45 
calculation regions included in adjacent groups 
and defining a boundary portion therebetween, 
thereby to limit a difference between the per- 
spective image information pieces on the 
respective pairs within a predetermined range, so 

12. An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 
forth in Claim 4, wherein the third means includes: 



55 



means for correcting a perspective image infor- 
mation piece on a parallax calculation region 
which is included in a group of parallax calcula- 



tion regions located vertically lower in screen 
than a parallax calculation region having a per- 
spective image information piece indicative of 
the nearest perspective position and which fias 
a perspective Image information piece indica- 
tive of a perspective position a predetermined 
value or more farther from a perspective posi- 
tion indicated by a perspective image informa- 
tion piece on a parallax calculation region 
immediately thereabove, the perspective 
image information piece on tiie former parallax 
calculation region being corrected to indicate a 
closer perspective position to that indicated by 
the perspective image information piece on the 
latter parallax calculation region; 
means for correcting perspective image infor- 
mation pieces on respective pairs of parallax 
calculation regions induded in adjacent groups 
and defining a Ixiundary portion therebetween 
thereby to limit a difference between the per- 
spective image information pieces on tiie 
respective pairs within a predetermined range; 
and 

means for smoothing perspective image infor- 
mation pieces on parallax calculation regions 
of the same group Xherehy to limit a difference 
in the perspective image information pieces 
thereon within a predetermined range. 

13. An apparatus for converting the twvo-dimensional 
images into the three<iimensional images as set 
forth in Claim 1 , wherein the phase control means 
includes: 

first storage means having a capacity to store 
the two-dimensional image signal representing 
up to the number of pixels included in one hor- 
izontal line and temporarily storing the two- 
dimensional image signal; 
second storage means having a capacity to 
store the two-dimensional image signal repre- 
senting up to the number of pixels included in 
one horizontal line and temporarily storing the 
two-dimensional image signal; 
first read-address control means which con- 
trols a read address of the first storage means 
relatively to a standard read address decided 
based on a horizontal/vertical position of the 
inputted two-dimensional image sigr^l accord- 
ing to the parallax information related to the 
predetermined unit area which includes a hori- 
zontal/vertical position of tiie inputted two- 
dimensional image signal, thereby generating 
the first Image signal a horizontal phase of 
which leads from a reference horizontal phase 
defined by said standard read address by a 
value based on said parallax information; and 
second read-address control means which 
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controls a read address of the second storage 
means relatively to said standard read address 
according to the parallax information related to 
the predetermined unit area which includes the 
horizontal/vertical position of the inputted two- $ 
dimensional image signal, thereby generating 
the second image signal a horizontal phase of 
which tags from the reference horizontal phase 
defined by said standard read address by a 
value based on said parallax information. io 

14. An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 
forth in Claim 1, wherein the perspective image 
characteristic value is an optional one selected is 
from the group consisting of luminance high-fre- 
quency component integration value, luminance 
contrast, luminance integration value, R-Y compo- 
nent integration value, B-Y component integration 
value and chroma integration value or an optional 20 
combination of the above. 

15. An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 
forth in Claini 1, wherein tiie predetermined unit 2ff 
area is an area consisting of one pixel. 

16. A method for converting two-dimensional images 
into three-dimensional ima:ges comprising the 
steps of: 30 

a first step of extracting, from an inputted two- 
dimensional image signal, a perspective image 
characteristic value of each of plural parallax 
calculation regions defined in a one-field 3S 
screen on a f ield-by-f ieki basis; 
a second step of generating parallax informa- 
tion on each of predetermined unit areas in the 
one-field screen by using the image character- 
istic value extracted per parallax calculation 40 
region; and 

a third step of generating a first image signal 
and a second image signal from a signal of the 
inputted two-dimensional image signal which 
resides in each predetermined unit area, the 45 
first and second image signals having a hori- 
zontal phase difference therebetween based 
on the parallax information related to the pre- 
determined unit area. 

so 

17. A method for converting the two-dimensional 
images into the three-dimensional Images as set 
forth in Claim 16, wherein the second step includes: 

a step of generating perspective image infer- 55 
mation on each parallax calculation region by 
using the perspective image characteristic 
value of each parallax calculation region; and 



a step of converting the perspective image 
information per parallax calculation region into 
parallax information per parallax calculation 
region. 

18. A method for converting the two-dimensional 
images into the three-dimensional images as set 
forth in Claim 16, wherein the second step includes: 

a step of generating perspective image infor- 
mation on each parallax calculation region by 
using the perspective image characteristic 
value of each parallax calculation region; 
a step of correcting a perspective image infor- 
mation piece on a parallax calculation region 
wNch is included in a group of parallax calcula- 
tion regions located vertically lower In screen 
than a parallax calculation region having a per- 
spective image information piece indicative of 
the nearest perspective position and which has 
a perspective image information piece indica- 
tive of a perspective position a predetermined 
value or more farther from a perspective posi- 
tion indicated by a perspective image informa- 
tion piece on a parallax calculation region 
immediately thereabove, the perspective 
image information piece on the former parallax 
calculation region being corrected to indicate a 
closer perspective position to that irKlicated by 
the perspective image information piece on tiie 
latter parallax calculation region; and 
a step of converting tiie corrected perspective 
image information piece on each parallax cal- 
culation region into parallax Information piece 
on each parallax calculation region. 

19. A method for converting the two-dimensional 
images into the three-dimensional images as set 
fortii in Claim 16, wherein the third step includes: 

a step of temporarily storing the inputted two- 
dimensional image signal in first storage 
means and second storage means, each stor- 
age means capable of storing the Inputted two- 
dimensional image signal representing up to 
the number of pixels included in one horizontal 
line; 

a step of controlling a read address of tiie first 
storage means relatively to a standard read 
address decided based on a horizontal/vertical 
position of the inputted two-dimensional image 
signal according to parallax information related 
to a predetermined unit area including the hor- 
izontal/vertical position of the inputted two- 
dimensional image signal, thereby generating 
the first image signal a horizontal phase of 
which leads from a reference horizontal phase 
defined by said standard read address by a 
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value based on said parallax information; and 
a step of controlling a read address of the sec- 
ond storage means relatively to said standard 
read address according to the parallax informa- 
tion related to the predetermined unit area 
including the horizontal/vertical position of the 
inputted two-dimensional image signal, thereby 
generating the second Image signal a horizon- 
tal phase of which lags from the reference hor- 
izontal phase defined by said standard read 
address by a value based on said parallax 
information. 

20. A method for converting the two-dimensional 
images Into the three-dimensional images as set 
forth in Claim 16, wherein the perspective image 
characteristic value is an optional one selected 
from tiie group consisting of luminance high-fre- 
quency component integration value, luminance 
contrast, luminance integration value and chroma 
integration value or an optional combination of the 
above. 

21. A method for converting the two-dimensional 
Images into the three-dimensional Images as set 
forth in Claim 16. wherein the predetermined unit 
area consists of one pixel. 

22. An apparatus for converting two-dimensional 
images into three-dimensional images comprising; 

motion vector sensing means for sensing, from 
an inputted two-dimensional image signal, a 
motion vector of each of plural motion-vector 
detection regions defined in a one-field screen 
on a field-by-fleld basis; 
parallax information generating means for gen- 
erating parallax information on each predeter- 
mined unit area in the one-field screen by using 
a horizontal component of the motion vector 
sensed per motion-vector detection region; and 
phase control means for generating a first 
image signal and a second image signal from a 
signal of the inputted two-dimensional image 
signal which resides in each predetermined 
unit area, the first and second innage signals 
having a horizontal phase difference therebe- 
tween based on parallax information related to 
the predetermined unit area. 

23. An apparatus for converting the two-dimensional 
images into the three-dimensional images as set 
forth in Claim 22. wherein the parallax information 
generating means generates tiie parallax informa- 
tion per predetermined unit area of tiie one-field 
screen based on a horizontal component of the 
motion vector sensed per motion-vector detection 
region, a maximum horizontal component value, a 
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motion vector detection region presenting the max- 
imum horizontal component value, a minimum hori- 
zontal component value, a motion-vector detection 
region presenting the minimum horizontal compo- 
5 nent value, and Information indicative of whettier an 
image corresponding to each motion-vector detec- 
tion region represents an object or a background. 

24- An apparatus for converting the two-dimensional 
10 images into the three-dimensional images as set 
forth in Claim 22, wherein the phase control means 
includes: 

first storage means having a capacity to store 
IS the inputted two-dimensional image signal rep- 

resenting up to tiie number of pixels included In 
one horizontal line and temporarily storing the 
inputted two-dimensional image signal; 
second storage means having a capacity to 
20 store the inputted two-dimensional image sig- 

nal representing up to the number of pixels 
included In one horizontal line and temporarily 
storing the inputted two-dimensional image sig- 
nal; 

25 first read-address control means which con- 

trols a read address of the first storage means 
relatively to a standard read address decided 
based on a horizontalAAertical position of the 
inputted two-dimensional image signal accord- 
30 ing to parallax information on a predetermined 

unit area including the horizontalA/ertical posi- 
tion of the inputted two-dimensional image sig- 
nal, thereby generating the first image signal a 
horizontal phase of which leads from a refer- 
35 ence horizontal phase defined by said standard 

read address by a value based on said parallax 
information; and 

second read-address control means which 
controls a read address of the second storage 
40 means relatively to said standard read address 

according to the parallax information on the 
predetermined unit area including the horizon- 
tal/vertical position of the inputted two-dimen- 
sional image signal, thereby generating the 
45 second image signal a horizontal phase of 

which lags from the reference horizontal phase 
defined by said standard read address by a 
value teased on said parallax information. 

so 25. An apparatus for converting tiie two-dimensional 
images into the three-dimensional images as set 
forth In Claim 22. wherein tiie predetermined unit 
area is an area consisting of one pixel. 

55 26. A method for converting two-dimensional images 
into three-dimensional images comprising the 
steps of: 
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a first step of sensing, from an inputted two- 
dimensional Image signal, a motion vector of 
each of pluraJ motion-vector detection regions 
defined in a one-field screen on a field-by^ield 
basis; 5 
a second step of generating parallax Informa- 
tion on each predetermined unit area in the 
one-field screen by using a horizontal compo- 
nent of the motion vector sensed per motion- 
vector detection region; and io 
a third step of generating a first image signal 
and a second image signal from a signal of the 
inputted two-dimensional image signal which 
resides in each predetermined unit area, the 
first and second image signals having a hori- is 
zontal phase difference therebetween based 
on parallax information related to the predeter- 
mined unit area. 

27. A method for converting the two-dimensional 20 
images into the three-dimensional images as set 
forth in Claim 26, wherein, in the second step, the 
parallax information is generated per predeter- 
mined unit area of the one-field screen by using a 
horizontal component of the motion vector sensed 25 
per motion-vector detection region, a maximum 
horizontal component value, a motion-vector detec- 
tion region presenting the maximum horizontal 
component value, a minimum horizontal compo- 
nent value, a motion-vector detection region pre- 30 
senting the minimum horizontal component value, 
and information indicative of whether an image cor- 
responding to each motion-vector detection region 
represents an object or a background. 

35 

28. A method for converting the two-dimensional 
images into the tiiree-dimensional images as set 
forth in Claim 26, wherein the third step includes: 

a step of temporarily storing the inputted two- 40 
dimensional image signal in first storage 
means and second storage means, each stor- 
age means having a capacity to store the input- 
ted two-dimensional image signal representing 
up to the number of pixels included in one hor- 4s 
Izontal line; 

a step of controlling a read address of the first 
storage means relativ^y to a standard read 
address decided based on a horizontalA/ertical 
position of the inputted two-dimensional image so 
signal according to parallax information related 
to a predetermined unit area including the hor- 
izontalA^ertical position of the inputted two- 
dimensional image signal, thereby generating 
the first image signal a horizontal phase of ss 
which leads from a reference horizontal phase 
defined by said standard read address by a 
value based on the parallax information; and 



a step of controlling a read address of the sec- 
ond storage means relatively to said standard 
read address according to the parallax informa- 
tion related to the predetermined unit area 
Including the horizontal/vertical position of the 
inputted two-dimensional image signal, thereby 
generating the second image signal a horizon- 
tal phase of which lags from the reference hor- 
izontal phase defined by said standard read 
address by a value based on said parallax 
information. 

29. A metiiod for converting the two-dimensional 
images into the three-dimensional images as set 
forth in Claim 26, wherein the predetermined unit 

area consists of one pixel. 

30. A stereoscopic effect adjusting method for adjusting 
a stereoscopic effect of a three-dimensional image 
by contirolling a sharpness of an image contour per 
predetermined unit area of the three-dimensional 
image according to perspective image information 
on each predetermined unit area of a one-field 
screen displaying the three-dimensional imaga 

31 . A stereoscopic effect adjusting method for adjusting 
a stereoscopic effect of a three-dimensional image 
by controlling a chroma per predetermined unit 
area of the three-dimensional Image according to 
perspective image information on each predeter- 
mined unit area of a one-field screen displaying the 
tiiree-dimensional image. 

32. A stereoscopic effect adjusting method for adjusting 
a stereoscopic effect of a three-dimensional image 
by controlling a sharpness of an image contour and 
a chroma per predetermined unit area of tiie three- 
dimensional image according to perspective image 
information on each predetermined unit area of a 
one-field screen displaying the three-dimensional 
image. 

33. A stereoscopic effect adjusting metiiod for adjusting 
the stereoscopic effect of the three-dimensional 
image as set forth in Claim 30. wherein the sharp- 
ness of the image contour is controlled by increas- 
ing a sharpness of an image contour related to an 
area representing a near-view image and by 
decreasing a sharpness of an image contour 
related to an area representing a distant-view 
image. 

34. A stereoscopic effect adjusting method for adjusting 
the stereoscopic effect of the three-dimensional 
image as set forth in Claim 31, wherein the image 
chroma is controlled by increasing a chroma of an 
area representing a near-view image and by 
decreasing a chroma of an area representing a dis- 
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tant-view image. 

35. A stereoscopic effect adjusting method for adjusting 
the stereoscopic effect of the three-dimensional 
image as set forth in Claim 32, wherein the sharp- 5 
ness of the image contour is controlled by increas- 
ing a sharpness of an image contour related to an 
area representing a near-view image and by 
decreasing a sharpness of an image contour 
related to an area representing a distant-view 
image while the chroma is controlled by increasing 
a chroma of the area representing the near-view 
image and by decreasing a chroma of the area rep- 
resenting the distant-view image. 

36. A stereoscopic effect adjusting apparatus compris- 
ing image contour controlling means for controlling 
a sharpness of an image corrtour per predeter- 
mined unit area of a three-dimensional image 
according to perspective image information on 
each predetermined unit area of a one-field screen 
displaying the three-dimensional image. 

37. A stereoscopic effect adjusting apparatus compris- 
ing chroma controlling means for controlling an 
image chroma per predetermined unit area of a 
three-dimensional image according to perspective 
image information on each predetermined unit area 
of a one-field screen displaying the three-dimen- 
sional image. 

38. A stereoscopic effect adjusting apparatus compris- 
ing: 

image contour controlling means for controlling 
a sharpness of an image contour per predeter- 
mined unit area of a three-dimensional image 
according to perspective image information on 
each predetermined unit area of a one-field 
screen displaying the three-dimensional 
image; and 

chroma controlling means for controlling a 
chroma per predetermined unit area of the 
three-dlmensionsil image according to the per- 
spective image information on each predeter- 
mined unit area of the one-field screen 
displaying the three-dimensional image. 

39. A stereoscopic effect adjusting apparatus as set 
forth in Claim 36. wherein the Image contour con- 
trolling means controls the sharpness of the image 
contour by increasing a sharpness of an image 
contour related to an area representing a near-view 
image and by decreasing a sharpness of an image 
contour related to an area representing a distarrt- 
view image. 



40. A stereoscopic effect adjusting apparatus as set 
forth in Claim 37. wherein the chroma controlling 
means controls the image chroma by increasing a 
chroma of an area representing a near-view image 
while decreasing a chroma of an area representing 
a distant-view image. 

41. A stereoscopic effect adjusting apparatus as set 
forth in Claim 38. wherein the image contour con- 
trolling means controls the sharpness of the image 
contour by increasing a sharpness of an image 
contour related to an area representing a near-view 
image and by decreasing a sharpness of an image 
contour related to an area representing a distant- 
view image, and 

wherein the chroma controlling means con- 
trols the image chroma by increasing a chroma of 
the area representing the near-view inoage and by 
decreasing a chroma of the area representing the 
distant-view image. 

42. A stereoscopic effect adjusting apparatus as set 
forth in Claim 36, wherein the image contour con- 
trolling means decreases a ratio of a low-frequency 
component and increases a ratio of a high-fre- 
quency component of the three-dimensional image 
signal in an area representing a near-view image, 
while increases a ratio of the low-frequency compo- 
nent and decreases a ratio of the high-frequency 
component of the three-dimensional image signal 
in an area representing a distant-view image. 

43. A stereoscopic effect adjusting apparatus as set 
forth in Claim 41, wherein the image contour con- 
trolling means decreases a ratio of a low-frequency 
component and increases a ratio of a high-fre- 
quency component of the three-dimensional image 
signal in an area representing a near-view image, 
while increases a ratio of the low-frequency compo- 
nent and decreases a ratio of the high-frequency 
component of the three-dimensional Image signal 
in an area representing a distant-view image. 

44. A two-dimensional/three-dimensional image con- 
verter comprising a plurality of field memories serv- 
ing to store a predetermined number of fields of an 
inputted two-dimensional image signal which are 
earlier than the cunrent field, and means for read- 
ing, from the plural field memories, respective pairs 
of image signals having a relative time difference 
therebetween and outputting one of the image sig- 
nal pair as a left-eye image signal and the other as 
a right-eye image signal, the two-dlmen- 
sionalAhree-dimensional image converter wherein 
a read clock for each field memory has a frequency 
set to twice the frequency of a write dock for the 
field memory. 
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